-- Logs begin at Mon 2022-06-06 13:37:40 UTC, end at Mon 2022-06-06 14:43:46 UTC. -- Jun 06 14:13:05.523109 dv-cinder-844140-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 14:13:05.533004 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 14:13:05 2022] *** Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: nodename: dv-cinder-844140-2-iscsi Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: machine: x86_64 Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: clock source: unix Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: pcre jit disabled Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: detected number of CPU cores: 4 Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: current working directory: / Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: detected binary path: /usr/bin/uwsgi-core Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: your processes number limit is 47680 Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: your memory page size is 4096 bytes Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: detected max file descriptor number: 2048 Jun 06 14:13:05.534934 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: lock engine: pthread robust mutexes Jun 06 14:13:05.535881 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: thunder lock: enabled Jun 06 14:13:05.535881 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 14:13:05.535881 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 14:13:05.580026 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: Python main interpreter initialized at 0x5604841df9c0 Jun 06 14:13:05.580026 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: python threads support enabled Jun 06 14:13:05.580026 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: your server socket listen backlog is limited to 100 connections Jun 06 14:13:05.580026 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: your mercy for graceful operations on workers is 90 seconds Jun 06 14:13:05.580409 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 14:13:05.580487 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: *** Operational MODE: preforking *** Jun 06 14:13:05.580718 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: *** uWSGI is running in multiple interpreter mode *** Jun 06 14:13:05.580718 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: spawned uWSGI master process (pid: 103168) Jun 06 14:13:05.580921 dv-cinder-844140-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 14:13:05.585730 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: spawned uWSGI worker 1 (pid: 103169, cores: 1) Jun 06 14:13:05.585730 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: spawned uWSGI worker 2 (pid: 103170, cores: 1) Jun 06 14:13:05.585730 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 14:13:06.835931 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 14:13:06.864912 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 14:13:07.575753 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:13:07.575753 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes Jun 06 14:13:07.576089 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:13:07.576089 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes Jun 06 14:13:07.578315 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:13:07.578315 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: from cryptography.utils import int_from_bytes Jun 06 14:13:07.578790 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:13:07.578790 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: from cryptography.utils import int_from_bytes Jun 06 14:13:10.200781 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 14:13:10.201382 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 14:13:10.201555 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 14:13:10.201942 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 14:13:10.202194 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 14:13:10.202574 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.202894 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.203201 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 14:13:10.203643 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.203643 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.203806 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 14:13:10.203891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.204151 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.204466 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.204714 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 14:13:10.204812 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.205080 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 14:13:10.205175 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.205330 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.205424 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 14:13:10.205639 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.205773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.205995 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-2-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.206097 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.206310 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.206405 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.206613 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.206718 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.206911 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207011 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207220 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207318 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207518 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207611 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207829 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.207917 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.208125 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.208218 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.208405 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.208616 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.208731 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209024 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-2-iscsi {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209145 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209341 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209466 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209642 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209798 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.209975 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210097 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210289 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210390 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210586 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210683 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210896 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.210988 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.211195 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.211292 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.211507 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.211699 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.211854 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212004 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212175 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-2-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212307 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212485 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212609 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212793 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.212947 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.213100 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.213257 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.213509 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.213650 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.213846 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.213945 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.214148 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.214241 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.214461 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.214549 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.214771 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.214909 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.215070 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.215176 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-2-iscsi {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.215389 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.215477 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.215702 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.215796 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216012 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216112 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216323 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216444 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216634 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.216917 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217037 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217219 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217352 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217531 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217668 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217854 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.217993 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.218153 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.218314 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.218408 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.218628 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.218725 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.218939 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.219028 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.219461 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.219558 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220092 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220216 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220362 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220468 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220611 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220709 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.220929 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221026 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221247 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221345 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221550 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221732 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221847 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.221945 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.222155 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.222244 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.222456 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.222567 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.222756 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.222851 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223055 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223143 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223319 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223419 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223569 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223667 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223884 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.223979 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.224202 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.224297 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.224505 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.224593 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.224807 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.224900 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.225108 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.225205 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.225407 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.225502 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.225756 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.225886 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226015 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226127 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226311 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226408 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226611 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226708 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.226923 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227018 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227235 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227331 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227549 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227648 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227848 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.227940 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.228146 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.228239 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.228447 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.228542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.228761 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.228850 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229067 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229365 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229460 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229610 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229697 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.229937 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230035 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230237 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230333 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230552 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230649 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230851 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.230941 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.231151 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.231248 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.231452 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.231546 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.231745 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.231839 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232045 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232139 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232346 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232440 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232591 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232677 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232890 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.232977 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.233189 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.233284 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.233501 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.233593 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.233819 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.233926 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.234117 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.234213 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.234414 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.234516 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.235260 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.235478 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.235603 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.235895 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.236346 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.236457 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.236666 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.236759 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.236974 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.237063 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.237279 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.237377 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.237583 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.237670 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.237911 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.238010 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.238216 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.238386 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.238514 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.238601 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.238812 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.239127 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.239428 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.239556 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.239732 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.239882 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240050 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240206 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240349 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240512 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240649 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240816 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.240962 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.241744 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.241883 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.241973 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242055 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242134 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242212 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242289 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242358 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242439 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242509 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242667 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242758 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.242969 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243083 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243269 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243359 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243562 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243657 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243876 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.243974 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.244177 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.244264 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.244478 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.244565 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.244777 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.244876 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.245075 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.245163 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.245387 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.245481 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.245689 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.245817 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.246057 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.246223 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.246378 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.246518 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.246677 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.246820 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.247005 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.247162 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.247330 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.247476 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.247624 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.247758 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.247901 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.248036 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.248197 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.248335 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.248516 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.248661 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.248832 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.248977 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.249137 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.249287 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.249432 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.249568 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.249753 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.249861 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.250051 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:13:10.250149 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.250994 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.251367 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.251552 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.251711 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.251897 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252029 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252242 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252329 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252557 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252652 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252889 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.252986 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.253219 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.253314 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.253536 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.253656 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.253871 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.253971 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.254189 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.254276 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.254515 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.254605 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.254824 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.254920 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.255133 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.255222 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.255440 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.255529 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.255749 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.255849 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.256057 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.256155 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.256373 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.256468 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.256687 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.256782 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257001 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257087 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257311 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257397 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257616 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257724 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.257947 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258033 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258255 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258340 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258565 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258689 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258865 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.258954 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.259199 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.259296 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.259509 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.259603 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.259821 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.259916 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.260135 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.260233 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.260448 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.260542 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.260753 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.260841 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261056 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261209 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261360 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261578 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261669 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261808 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.261976 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262078 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262276 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262370 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262579 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262666 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262879 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.262980 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.263192 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.263286 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.263501 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.263589 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.263802 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.263890 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.264104 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.264191 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.264420 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.264506 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.264726 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.264816 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265032 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265126 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265336 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265422 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265633 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265748 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.265999 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.266097 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.266507 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.266815 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.266913 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.267137 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.267233 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.267448 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.267539 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.267750 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.267848 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268059 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268146 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268358 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268446 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268659 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268753 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.268965 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.269051 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.269271 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.269365 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.269572 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.269667 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.269908 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270012 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270316 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270518 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270607 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270823 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.270918 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.271125 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.271227 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.271423 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.271579 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.271729 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.271827 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272035 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272132 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272334 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272432 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272653 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272751 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.272974 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273116 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273253 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273341 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273558 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273653 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273884 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.273985 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.274185 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.274279 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.274484 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.274571 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.274785 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.274874 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275082 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275167 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275379 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275467 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275676 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275765 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.275975 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276063 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276273 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276368 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276579 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276674 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276881 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.276967 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.277179 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.277266 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.277478 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.277567 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.277798 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.277891 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.278136 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.278237 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.278439 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.278540 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.278737 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.278824 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279042 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279138 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279341 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279429 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279642 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279730 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.279941 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280040 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280245 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280332 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280545 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280634 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280845 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.280942 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.281143 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.281231 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.281443 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.281532 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.281821 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.282128 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.282305 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.282617 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.282706 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.282927 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283029 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283230 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283359 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283540 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283635 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283841 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.283938 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.284141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.284228 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.284453 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.284547 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.284787 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.284888 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.285116 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.285204 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.285427 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.285515 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.285766 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.285859 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286074 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286161 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286385 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286477 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286687 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286776 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.286992 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.287079 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.287314 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.287402 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.287602 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.287689 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.287912 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288006 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288215 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288310 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288526 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288615 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288828 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.288915 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.289143 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.289236 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.289447 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.289536 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.289777 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.289866 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.290082 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.290250 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.290389 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.290478 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.290713 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.290802 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291037 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291133 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291342 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291649 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291806 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.291936 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292033 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292250 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292348 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292553 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292647 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292854 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.292950 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.293150 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.293283 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.293452 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.293541 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.293778 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.293871 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294081 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294167 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294384 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294470 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294686 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294774 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.294983 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295077 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295290 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295385 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295593 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295719 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295889 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.295978 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.296182 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.296268 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.296484 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.296581 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.296798 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.296885 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.297100 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.298232 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.298388 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.298797 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.298893 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.299109 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.299199 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.299415 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.299506 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.299734 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.299828 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300040 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300140 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300341 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300430 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300648 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300735 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.300946 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.301082 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.301263 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.301359 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.301573 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.301671 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.301896 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302034 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302198 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302287 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302508 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302597 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302812 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.302912 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.303112 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.303199 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.303413 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.303508 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.303718 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.303818 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304037 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304135 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304343 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304458 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304646 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304744 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.304953 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.305043 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.305261 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.305371 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.305564 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.305786 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.305895 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.306207 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.306367 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.306511 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.306817 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.306905 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.307124 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.307425 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.307512 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.307732 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.308005 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.308098 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.308381 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.308619 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.308738 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.308949 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.309047 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.309261 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.309365 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.309575 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.309672 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.309915 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310020 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310232 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310320 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310567 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310665 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310889 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.310989 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.311197 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.311293 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.311517 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.311615 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.311824 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.311925 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.312128 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.312262 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.312427 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.312515 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.312731 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.312865 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.313697 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.314026 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.314329 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.314552 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.314641 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.314893 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.314983 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.315218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.315321 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.315512 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.315601 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.315814 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.315904 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.316124 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.316211 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.316423 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.316519 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.316731 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.316818 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.317031 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.317118 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.317362 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.317628 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.317743 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.317987 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318074 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318290 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318412 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318592 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318683 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318909 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.318996 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.319224 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.319320 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.319553 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.319643 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.319877 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.319972 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.320216 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.320313 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.320519 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.320620 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.320820 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.320914 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.321122 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.321210 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.321426 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.321529 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.321760 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.321853 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322053 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322186 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322358 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322436 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322662 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322758 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.322963 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323051 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323264 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323352 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323565 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323653 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323863 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.323951 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.324165 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.324252 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.324462 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.324557 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.324767 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.324853 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325065 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325154 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325365 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325453 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325668 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325785 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.325996 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326085 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326295 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326384 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326595 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326691 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326896 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.326984 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.327194 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.327281 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.327499 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.327601 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.327797 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.327886 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.328109 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.328204 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.328434 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.328535 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.328759 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.328848 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.329061 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.329368 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.329672 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.329857 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.329999 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.330138 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.330331 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.330445 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.330639 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.330737 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.330939 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331036 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331238 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331326 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331542 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331631 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331840 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.331928 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.332137 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.332271 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.332441 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.332572 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.332759 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.332847 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.333071 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.333176 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.333371 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.333458 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.333674 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.333871 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334003 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334109 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334302 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334398 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334601 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334689 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334902 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.334999 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.335198 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.335293 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.335496 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.335584 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.335793 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.335890 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.336091 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.336178 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.336387 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.336480 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.336687 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.336781 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337001 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337096 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337298 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337385 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337599 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337688 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.337919 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338009 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338239 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338381 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338546 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338642 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338848 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.338938 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.339175 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.339263 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.339483 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.339574 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.339785 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.339881 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340089 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340190 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340397 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340485 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340697 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340784 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.340994 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.341094 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.341297 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.341384 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.341598 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.341694 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.341936 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342038 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342235 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342322 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342536 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342664 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342835 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.342931 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.343137 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.343234 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.343437 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.343526 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.343741 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.343831 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.344069 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.344162 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.344373 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.344461 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.344709 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.344990 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.345296 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.345448 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.345602 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.345788 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.345967 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.346096 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.346227 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.346423 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.346562 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.346826 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.346924 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.347132 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.347228 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.347437 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.347533 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.347743 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.347833 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348078 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348164 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348381 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348513 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348684 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348772 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.348984 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.349087 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.349307 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.349395 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.349612 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.349750 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.349939 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350027 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350248 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350334 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350546 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350642 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350846 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.350934 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.351144 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.351239 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.351451 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.351583 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.351762 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.351891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352062 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352196 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352363 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352496 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352684 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352805 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.352991 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.353089 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.353296 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.353393 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.353613 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.353726 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.353957 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354069 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354284 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354398 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354584 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354705 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354890 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.354992 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.355195 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.355284 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.355500 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.355588 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.355806 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.355896 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.356112 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.356200 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.356417 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.356514 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.356723 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.356813 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357029 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357123 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357324 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357411 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357627 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357744 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.357956 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358043 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358262 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358361 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358567 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358681 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358867 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.358989 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.359193 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.359296 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.359498 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.360224 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.360644 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.360911 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.361492 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.361597 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.361836 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.361942 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.362159 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.362255 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.362463 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.362560 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.362770 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.362900 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.363072 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.363216 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.363391 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.363532 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.363708 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.363844 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364014 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364152 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364324 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364464 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364625 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.364941 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.365086 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.365257 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.365404 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.365565 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.365722 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.365913 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.366148 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.366330 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.366459 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.366648 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.366774 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.366952 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367049 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367268 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367366 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367587 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367681 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367886 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.367999 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.368184 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.368280 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.368488 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.368576 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.368785 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.368876 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.369087 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.369184 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.369407 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.369494 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.369727 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.369819 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370036 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370135 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370342 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370483 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370650 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370739 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.370949 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.371047 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.371246 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.371434 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.371563 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.371742 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.371862 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.372045 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.372178 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.372364 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.372488 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.372681 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.372803 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373015 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373140 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373308 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373399 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373618 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373739 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.373946 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374267 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374363 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374587 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374694 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374882 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.374978 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.375196 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.375313 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.375557 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.375808 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.376138 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.376473 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.376573 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.376796 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.376944 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.377106 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.377196 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.377439 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.377531 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.377786 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.377915 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.378102 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.378239 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.378416 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.378547 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.378737 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.378872 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379038 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379175 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379337 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379478 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379642 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379780 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.379940 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.380085 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.380241 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.380386 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.380546 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.380689 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.380848 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381006 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381146 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381308 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381444 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381616 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381762 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.381945 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.382082 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.382250 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.382384 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.382552 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.382701 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.382850 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383007 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383172 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383315 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383469 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383614 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383788 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.383910 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.384096 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.384248 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.384412 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.384550 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.384728 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.384879 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385029 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385197 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385348 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385517 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385660 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385880 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.385982 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.386186 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.386276 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.386505 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.386595 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.386817 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.386908 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.387126 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.387215 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.387434 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.387522 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.387743 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.387833 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388050 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388147 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388357 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388445 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388664 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388754 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.388968 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.389055 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.389277 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.389373 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.389584 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.389673 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.389922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.390012 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.390221 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.390488 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.390578 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.390811 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.391416 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.391688 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.391997 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.392236 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.392336 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.392552 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.392663 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.392861 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.392972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.393170 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.393277 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.393474 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.393575 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.393794 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.393900 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.394097 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.394188 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.394417 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.394508 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.394718 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.394884 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395039 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395142 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395346 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395434 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395645 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395743 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.395947 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396044 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396251 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396340 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396590 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396693 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396889 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.396977 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.397219 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.397315 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.397533 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.397629 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.397868 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.397960 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.398184 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.398272 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.398487 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.398576 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.398790 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.398884 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.399097 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.399185 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.399404 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.399498 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.399709 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.399797 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400015 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400110 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400316 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400411 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400622 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400709 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.400929 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.401026 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.401232 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.401325 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.401544 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.401632 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.401876 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.402042 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.402185 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.402272 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.402495 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.402733 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.402831 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.403057 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.403310 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.403398 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.403625 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.403726 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.403951 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404041 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404258 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404345 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404566 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404669 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404872 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.404963 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.405175 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.405264 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.405480 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.405570 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.405802 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.405894 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.406105 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.406193 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.406412 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.406530 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407087 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407235 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407337 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407429 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407512 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407665 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407764 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.407979 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.408068 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.408291 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.408378 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.408592 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.408681 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.408947 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.409119 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.409257 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.409463 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.409553 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.409796 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.409887 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.410120 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.410211 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.410439 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.410530 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.410751 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.410840 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411061 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411148 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411370 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411460 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411669 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411756 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.411970 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412067 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412270 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412361 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412572 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412659 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412871 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.412967 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.413169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.413264 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.413473 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.413569 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.413799 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.413905 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.414101 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.414190 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.414405 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.414493 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.414704 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.414795 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415023 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415218 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415317 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415524 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415628 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415856 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.415947 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.416176 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.416274 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.416472 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.416568 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.416770 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.416859 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417070 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417158 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417369 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417471 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417673 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417820 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.417996 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418092 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418295 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418383 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418594 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418682 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418891 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.418978 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.419187 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.419323 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.419491 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.419588 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.419785 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.419873 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.420101 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.420193 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.420404 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.420492 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.420715 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.420933 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.421031 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.421279 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.421368 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.421590 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.421678 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.421936 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.422038 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.422890 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.423469 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.423560 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.423903 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.424001 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.424216 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.424441 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.424537 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.424777 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.424873 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.425097 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.425186 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.425423 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.425517 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.425752 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.425893 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426057 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426204 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426359 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426508 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426670 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426811 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.426972 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.427129 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.427271 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.427436 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.427575 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.427742 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.427871 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428045 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428188 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428351 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428490 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428655 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428789 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.428960 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429086 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429263 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429399 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429566 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429656 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429906 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.429995 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.430210 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.430311 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.430513 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.430603 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.430816 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.430904 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.431120 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.431217 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.431421 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.431515 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.431721 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.431810 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432027 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432192 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432326 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432415 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432630 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432718 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.432945 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433039 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433249 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433346 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433555 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433642 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433873 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.433964 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.434177 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.434264 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.434480 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.434575 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.434799 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.434889 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.435105 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.435192 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.435405 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.435493 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.435743 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.435830 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.436055 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.436151 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.436416 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.436593 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.436729 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.436926 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.437021 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.437244 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.437333 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.437575 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.437672 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.438142 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.438525 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.438615 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.438860 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.438973 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.439167 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.439257 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.439471 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.439560 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.439793 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.439884 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.440101 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.440191 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.440409 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.440497 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.440708 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.440803 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441008 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441097 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441311 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441397 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441614 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441722 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.441944 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442031 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442244 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442543 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442633 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442844 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.442938 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.443139 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.443235 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.443438 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.443526 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.443736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.443827 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444034 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444131 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444335 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444424 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444630 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444755 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.444926 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445023 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445222 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445318 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445517 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445606 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445837 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.445941 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.446135 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.446232 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.446438 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.446526 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.446734 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.446823 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447032 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447120 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447328 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447417 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447626 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447756 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.447920 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.448068 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.448246 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.448490 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.448580 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.448801 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.448888 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.449115 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.449210 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.449430 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.449521 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.449756 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.449847 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450070 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450157 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450385 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450474 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450693 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450826 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.450999 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.451088 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.451300 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.451388 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.451624 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.451712 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.451925 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452024 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452229 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452325 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452533 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452622 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452837 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.452934 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.453141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.453236 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.453501 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.453595 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.454024 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.454353 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.454452 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.454657 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.454747 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.454979 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455076 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455285 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455373 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455588 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455684 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455895 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.455997 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.456196 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.456284 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.456496 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.456594 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.456800 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.456899 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.457100 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.457190 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.457403 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.457498 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.457713 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.457817 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458017 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458107 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458317 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458404 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458615 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458711 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.458914 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459003 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459212 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459302 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459518 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459608 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459817 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.459905 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.460116 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.460204 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.460415 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.460505 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.460712 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.460807 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461010 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461099 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461334 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461426 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461662 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461810 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.461997 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.462099 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.462301 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.462396 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.462541 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 14:13:10.462630 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.462913 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.463217 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.463532 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.463849 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.464160 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.464464 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.464790 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.465093 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.465395 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.465717 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.466024 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.466335 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.466639 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.466962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.467282 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.467584 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.467904 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.468217 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.468532 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.468843 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.470075 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.470494 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.470803 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.471111 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.471424 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.471729 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.472035 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.472348 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.472660 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.472984 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.473306 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.473612 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.473958 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.474283 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.474626 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.474933 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.475275 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.475597 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.475907 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.476213 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.476520 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:13:10.476761 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 14:13:10.521240 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Registered counter for database nova_api Jun 06 14:13:10.538251 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO dbcounter [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Registered counter for database nova_api Jun 06 14:13:10.548753 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.555794 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.559353 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_db.sqlalchemy.engines [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.566776 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writer thread running {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.613653 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.context [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26f43c31-b475-46bf-a782-cf1fcb4532b4(cell1) {{(pid=103170) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 14:13:10.617858 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:13:10.619414 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:13:10.620201 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:13:10.622193 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:13:10.624198 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Registered counter for database nova_cell0 Jun 06 14:13:10.624519 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.context [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26f43c31-b475-46bf-a782-cf1fcb4532b4(cell1) {{(pid=103169) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 14:13:10.628496 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Registered counter for database nova_cell1 Jun 06 14:13:10.629224 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_concurrency.lockutils [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:13:10.630820 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_concurrency.lockutils [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:13:10.631673 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_concurrency.lockutils [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:13:10.633601 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_concurrency.lockutils [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:13:10.635712 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO dbcounter [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Registered counter for database nova_cell0 Jun 06 14:13:10.635903 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.637341 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.639996 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO dbcounter [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Registered counter for database nova_cell1 Jun 06 14:13:10.645042 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.647554 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.648294 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_db.sqlalchemy.engines [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.653126 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writer thread running {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.653795 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_db.sqlalchemy.engines [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.802097 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writer thread running {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.810584 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Registered counter for database nova_cell0 Jun 06 14:13:10.810959 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO dbcounter [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Registered counter for database nova_cell0 Jun 06 14:13:10.819620 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.821133 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG oslo_db.sqlalchemy.engines [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:13:10.824297 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:10.825324 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writer thread running {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:13:11.283809 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:13:11.291079 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:13:11.305748 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: WARNING keystonemiddleware.auth_token [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:13:11.313635 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: WARNING keystonemiddleware.auth_token [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:13:11.512039 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:13:11.518336 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:13:11.523414 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604841df9c0 pid: 103170 (default app) Jun 06 14:13:11.526596 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:13:11.527775 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002843 Jun 06 14:13:11.528469 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Jun 6 14:13:11 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:13:11.543082 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: WARNING keystonemiddleware.auth_token [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:13:11.549979 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: WARNING keystonemiddleware.auth_token [None req-7cde0dd1-ce3d-4af8-8d77-7f5267cd1622 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:13:11.555414 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604841df9c0 pid: 103169 (default app) Jun 06 14:14:35.988709 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:35.989790 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 06 14:14:35.990671 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:14:36.016028 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writing DB stats nova_api:SELECT=3 {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:36.017951 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writing DB stats nova_cell0:SELECT=3 {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:36.019124 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writing DB stats nova_cell1:SELECT=3 {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:36.019850 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:36.496721 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-6cf12f4f-6d67-440f-b99d-af64756a00f7 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:36.530244 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-6cf12f4f-6d67-440f-b99d-af64756a00f7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.530153 Jun 06 14:14:36.531204 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 14:14:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:14:39.021096 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:39.022234 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-328b2a28-39d0-40fe-86d5-875382751382 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jun 06 14:14:39.022658 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:14:39.098583 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-586b18ee-f9b5-4bc5-a088-2bd971377183 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "name": "cirros256", "vcpus": 1}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:39.123104 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:14:39.123104 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: warnings.warn(msg) Jun 06 14:14:39.161466 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-586b18ee-f9b5-4bc5-a088-2bd971377183 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.129694 Jun 06 14:14:39.168572 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 14:14:39.178489 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:39.179853 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:39.180903 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:39.181925 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:14:39.402729 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-2cfcbd56-dbb4-4b38-85a3-c8c8ad8ccfc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:39.405186 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:14:39.405186 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 06 14:14:39.471220 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-2cfcbd56-dbb4-4b38-85a3-c8c8ad8ccfc8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.298454 Jun 06 14:14:39.477877 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 14:14:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:14:41.942763 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-586b18ee-f9b5-4bc5-a088-2bd971377183 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:41.943812 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-586b18ee-f9b5-4bc5-a088-2bd971377183 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 06 14:14:41.944240 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:14:42.068605 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bc106993-c0de-4d02-8024-7b2ba3ef4643 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d1", "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:42.087118 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:14:42.087118 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 06 14:14:42.122221 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bc106993-c0de-4d02-8024-7b2ba3ef4643 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.166782 Jun 06 14:14:42.123516 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 14:14:42.139164 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-81c67370-cc84-4cdf-b5d2-f5b5502f222b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:42.140979 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:14:42.140979 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: warnings.warn(msg) Jun 06 14:14:42.186325 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-81c67370-cc84-4cdf-b5d2-f5b5502f222b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051224 Jun 06 14:14:42.187565 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 14:14:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:14:44.627644 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bc106993-c0de-4d02-8024-7b2ba3ef4643 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:44.629364 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bc106993-c0de-4d02-8024-7b2ba3ef4643 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jun 06 14:14:44.630201 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:14:44.716700 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-a526b01f-b892-425d-8d8f-df473bbd6ac3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:44.741085 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-a526b01f-b892-425d-8d8f-df473bbd6ac3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102724 Jun 06 14:14:44.742199 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:14:44.758196 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-345dc480-2ea2-415c-b0bf-1553860e4764 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:44.798477 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-345dc480-2ea2-415c-b0bf-1553860e4764 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044549 Jun 06 14:14:44.799265 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 14:14:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:14:47.382678 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-a526b01f-b892-425d-8d8f-df473bbd6ac3 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:47.384023 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-a526b01f-b892-425d-8d8f-df473bbd6ac3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Jun 06 14:14:47.384559 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:14:47.460386 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6606cf87-a37d-4e1f-bebb-07cea426b570 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:47.485156 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6606cf87-a37d-4e1f-bebb-07cea426b570 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093137 Jun 06 14:14:47.485972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:14:47.508220 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-cee790c6-e3e8-49fc-b421-ef823249a9ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:47.549021 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-cee790c6-e3e8-49fc-b421-ef823249a9ec admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047511 Jun 06 14:14:47.554071 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 14:14:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:14:50.111200 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6606cf87-a37d-4e1f-bebb-07cea426b570 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:50.112647 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6606cf87-a37d-4e1f-bebb-07cea426b570 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Jun 06 14:14:50.113232 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:14:50.201884 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-5e91326f-aef8-480a-8846-16201fbe6a6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 20}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:50.233441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-5e91326f-aef8-480a-8846-16201fbe6a6a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.111709 Jun 06 14:14:50.235160 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:14:50.248552 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-8cf3a8f4-febc-4285-b261-9c01ed75ab0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:50.289932 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-8cf3a8f4-febc-4285-b261-9c01ed75ab0b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044556 Jun 06 14:14:50.289932 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 14:14:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:14:53.394907 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-5e91326f-aef8-480a-8846-16201fbe6a6a admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:53.395924 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-5e91326f-aef8-480a-8846-16201fbe6a6a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 06 14:14:53.396546 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:14:53.463745 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-258fad42-095b-43db-aec8-0db00a8d2b5d admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:53.488389 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-258fad42-095b-43db-aec8-0db00a8d2b5d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084440 Jun 06 14:14:53.495267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 14:14:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:14:55.979815 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-5e91326f-aef8-480a-8846-16201fbe6a6a admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:55.980831 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-5e91326f-aef8-480a-8846-16201fbe6a6a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jun 06 14:14:55.981465 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:14:56.054563 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-19b24258-166f-452b-be5e-677a48aefe79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:56.077915 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-19b24258-166f-452b-be5e-677a48aefe79 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089296 Jun 06 14:14:56.078405 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:14:56.094002 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-cc93f99c-3ac3-45ef-b601-3c7182705067 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:56.137321 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-cc93f99c-3ac3-45ef-b601-3c7182705067 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049521 Jun 06 14:14:56.138921 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 14:14:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:14:58.733067 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-19b24258-166f-452b-be5e-677a48aefe79 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:14:58.734380 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-19b24258-166f-452b-be5e-677a48aefe79 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Jun 06 14:14:58.734943 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:14:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:14:58.806294 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-238df93b-ff26-421b-96a0-37678577f7e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:58.826994 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-238df93b-ff26-421b-96a0-37678577f7e0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086010 Jun 06 14:14:58.827567 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:14:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 14:14:58.840919 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-2b707f2e-e9e2-4c90-b30d-54abdfc8d7cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:14:58.871768 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-2b707f2e-e9e2-4c90-b30d-54abdfc8d7cc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035422 Jun 06 14:14:58.872921 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 14:14:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:15:01.398038 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-238df93b-ff26-421b-96a0-37678577f7e0 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:01.399215 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-238df93b-ff26-421b-96a0-37678577f7e0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jun 06 14:15:01.400017 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:15:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:15:01.498320 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-34ff61a1-afd9-4eee-9b92-1a46166ce23e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:01.529922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-34ff61a1-afd9-4eee-9b92-1a46166ce23e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.121657 Jun 06 14:15:01.530636 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:15:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:01.547108 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-a0e998bb-22ef-492e-8ff1-f7df59780367 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:01.578915 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-a0e998bb-22ef-492e-8ff1-f7df59780367 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036868 Jun 06 14:15:01.579779 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 14:15:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:15:04.114374 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-34ff61a1-afd9-4eee-9b92-1a46166ce23e admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:04.117108 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-34ff61a1-afd9-4eee-9b92-1a46166ce23e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003492 Jun 06 14:15:04.117945 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:15:04 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:04.180256 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-b2b156f0-d2c2-4266-939a-e068b18678d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:04.205992 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-b2b156f0-d2c2-4266-939a-e068b18678d0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079398 Jun 06 14:15:04.206722 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:15:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:04.224768 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e7f7c8b5-d0f1-4543-820c-74087d844842 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:04.253692 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-e7f7c8b5-d0f1-4543-820c-74087d844842 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034985 Jun 06 14:15:04.254596 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 14:15:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:15:06.882962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-b2b156f0-d2c2-4266-939a-e068b18678d0 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:06.885855 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-b2b156f0-d2c2-4266-939a-e068b18678d0 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003623 Jun 06 14:15:06.886993 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:15:06 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:06.968075 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bb52c78d-f9cb-43dd-a4af-544f1db43c45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:06.991159 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bb52c78d-f9cb-43dd-a4af-544f1db43c45 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.096614 Jun 06 14:15:06.991708 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 14:15:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:07.004402 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-8ab4c663-db91-41d5-ab99-af1238b356c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:07.008568 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:15:07.031728 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-8ab4c663-db91-41d5-ab99-af1238b356c4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030993 Jun 06 14:15:07.032299 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 14:15:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:15:33.141760 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bb52c78d-f9cb-43dd-a4af-544f1db43c45 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:33.142794 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bb52c78d-f9cb-43dd-a4af-544f1db43c45 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 06 14:15:33.143195 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:33.208252 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-4b8bac33-4f1c-43b7-a789-761699658b14 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:33.227513 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-4b8bac33-4f1c-43b7-a789-761699658b14 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077391 Jun 06 14:15:33.228071 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 14:15:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:15:34.266011 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bb52c78d-f9cb-43dd-a4af-544f1db43c45 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:34.267032 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bb52c78d-f9cb-43dd-a4af-544f1db43c45 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 06 14:15:34.267440 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:34.491258 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-c5b229b5-173e-4ed5-8f7b-61b6ac0d0cfb admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:34.498960 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.wsgi [None req-c5b229b5-173e-4ed5-8f7b-61b6ac0d0cfb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-c5b229b5-173e-4ed5-8f7b-61b6ac0d0cfb admin admin] Request method failure captured: Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Accept: application/json Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Accept-Encoding: gzip, deflate Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Connection: keep-alive Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Content-Length: 0 Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Host: 10.222.0.13 Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Openstack-Api-Version: compute 2.90 Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Openstack-System-Scope: None Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: User-Agent: python-novaclient Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Auth-Token: gAAAAABingwG05SVkwGwYRRfasbmEMEBbbAuNQxLGcDC-dD52VvliBaMYfeH8RUkSRIbeHv93q6o3-VRLUlrR6npwG1Z866JbbIFGSsAD0qMWgSmQx0vVFM8DBu9wx4BYOww-nFn6EUuVWWffzQJdS4ugT332UZuJILc2r2yXJ798pGXrHIQsEM Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Domain-Id: None Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Domain-Name: None Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Identity-Status: Confirmed Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Is-Admin-Project: True Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Domain-Id: default Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Domain-Name: Default Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Name: admin Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Role: member,reader,admin Jun 06 14:15:34.502298 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Roles: member,reader,admin Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258fdfe108b84b6c82c61b2a2990c11d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}] Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant: admin Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant-Name: admin Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User: admin Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Domain-Id: default Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Domain-Name: Default Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Id: e2d188b242aa4be3ac73c99d08c98dbe Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Name: admin Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: method: > Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: exception: Flavor 42 could not be found. Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: action_args: {'id': '42'} Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:15:34.503773 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:34.505064 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.506619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-c5b229b5-173e-4ed5-8f7b-61b6ac0d0cfb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:15:34.508032 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-c5b229b5-173e-4ed5-8f7b-61b6ac0d0cfb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074949 Jun 06 14:15:34.508032 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 14:15:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 14:15:34.515350 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d86d25ae-9665-4811-bb3d-ec9c4d462dac admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:34.522331 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:15:34.548433 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-d86d25ae-9665-4811-bb3d-ec9c4d462dac admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038225 Jun 06 14:15:34.549036 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 14:15:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:15:34.570090 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-4ca88cb3-a6a7-411d-a7d5-84fd095e8ba9 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:34.597581 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-4ca88cb3-a6a7-411d-a7d5-84fd095e8ba9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031174 Jun 06 14:15:34.598195 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 14:15:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:15:34.613828 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d0189269-adc9-4f48-bab0-f2b5bf72a10a admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:34.627395 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-d0189269-adc9-4f48-bab0-f2b5bf72a10a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d0189269-adc9-4f48-bab0-f2b5bf72a10a admin admin] Request method failure captured: Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Accept: application/json Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Connection: keep-alive Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Content-Length: 0 Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Host: 10.222.0.13 Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABingwG05SVkwGwYRRfasbmEMEBbbAuNQxLGcDC-dD52VvliBaMYfeH8RUkSRIbeHv93q6o3-VRLUlrR6npwG1Z866JbbIFGSsAD0qMWgSmQx0vVFM8DBu9wx4BYOww-nFn6EUuVWWffzQJdS4ugT332UZuJILc2r2yXJ798pGXrHIQsEM Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Role: member,reader,admin Jun 06 14:15:34.635736 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Roles: member,reader,admin Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258fdfe108b84b6c82c61b2a2990c11d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}] Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant: admin Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User: admin Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Id: e2d188b242aa4be3ac73c99d08c98dbe Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Name: admin Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: method: > Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: exception: Flavor 42 could not be found. Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: action_args: {'id': '42'} Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:15:34.637169 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:34.638030 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:34.639141 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d0189269-adc9-4f48-bab0-f2b5bf72a10a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:15:34.640614 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-d0189269-adc9-4f48-bab0-f2b5bf72a10a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.032296 Jun 06 14:15:34.644136 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 14:15:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 14:15:35.627091 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-4ca88cb3-a6a7-411d-a7d5-84fd095e8ba9 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:35.628109 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-4ca88cb3-a6a7-411d-a7d5-84fd095e8ba9 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 06 14:15:35.628534 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:35.898719 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ac6ca7b1-7ed6-431a-947a-490b09201f8a admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:35.906394 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-ac6ca7b1-7ed6-431a-947a-490b09201f8a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ac6ca7b1-7ed6-431a-947a-490b09201f8a admin admin] Request method failure captured: Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Accept: application/json Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Connection: keep-alive Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Content-Length: 0 Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Host: 10.222.0.13 Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABingwH0YzWNiF7HcYxL7mtpXhneEb8OpqoAPpV7wEnvuFEEG_XrJH5HNfN31lUmMZst6Mw2rL8NXB1_cc1HG2ltUztHQCZppgmQLtjY-mtQMycs18CclIxTcBaTpXaL8sIEoLNJwIN6PRiHQ6tnSEdvFtRLjK1tqRgbkicgKN65ZlVfFY Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Role: member,reader,admin Jun 06 14:15:35.907972 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Roles: member,reader,admin Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258fdfe108b84b6c82c61b2a2990c11d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}] Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant: admin Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User: admin Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Id: e2d188b242aa4be3ac73c99d08c98dbe Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Name: admin Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: method: > Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: exception: Flavor 84 could not be found. Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: action_args: {'id': '84'} Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:15:35.910922 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:35.912891 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.916046 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ac6ca7b1-7ed6-431a-947a-490b09201f8a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:15:35.918503 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ac6ca7b1-7ed6-431a-947a-490b09201f8a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.088602 Jun 06 14:15:35.918503 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 14:15:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 14:15:35.921035 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-1b8dc953-cfc2-4c33-a491-4901e725fd54 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:35.935067 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-1b8dc953-cfc2-4c33-a491-4901e725fd54 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017923 Jun 06 14:15:35.935616 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 14:15:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:15:35.949271 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-40491883-bb8c-4a7d-8851-cf6e33dff448 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:35.963835 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-40491883-bb8c-4a7d-8851-cf6e33dff448 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018118 Jun 06 14:15:35.964391 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 14:15:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:15:35.974050 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-a4955de5-e4be-413d-ac61-fb8dde089633 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:35.979436 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.wsgi [None req-a4955de5-e4be-413d-ac61-fb8dde089633 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-a4955de5-e4be-413d-ac61-fb8dde089633 admin admin] Request method failure captured: Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Accept: application/json Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Accept-Encoding: gzip, deflate Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Connection: keep-alive Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Content-Length: 0 Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Host: 10.222.0.13 Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Openstack-Api-Version: compute 2.90 Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Openstack-System-Scope: None Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: User-Agent: python-novaclient Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Auth-Token: gAAAAABingwH0YzWNiF7HcYxL7mtpXhneEb8OpqoAPpV7wEnvuFEEG_XrJH5HNfN31lUmMZst6Mw2rL8NXB1_cc1HG2ltUztHQCZppgmQLtjY-mtQMycs18CclIxTcBaTpXaL8sIEoLNJwIN6PRiHQ6tnSEdvFtRLjK1tqRgbkicgKN65ZlVfFY Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Domain-Id: None Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Domain-Name: None Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Identity-Status: Confirmed Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Is-Admin-Project: True Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Domain-Id: default Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Domain-Name: Default Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Name: admin Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Role: member,reader,admin Jun 06 14:15:35.980962 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Roles: member,reader,admin Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258fdfe108b84b6c82c61b2a2990c11d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}] Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant: admin Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant-Name: admin Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User: admin Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Domain-Id: default Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Domain-Name: Default Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Id: e2d188b242aa4be3ac73c99d08c98dbe Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Name: admin Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: method: > Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: exception: Flavor 84 could not be found. Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: action_args: {'id': '84'} Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:15:35.982441 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:35.983548 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:35.984692 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-a4955de5-e4be-413d-ac61-fb8dde089633 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:15:35.985839 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-a4955de5-e4be-413d-ac61-fb8dde089633 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012040 Jun 06 14:15:35.986688 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 14:15:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 06 14:15:36.864940 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-40491883-bb8c-4a7d-8851-cf6e33dff448 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:36.865994 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-40491883-bb8c-4a7d-8851-cf6e33dff448 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 06 14:15:36.866436 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:37.059795 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-6a14d2b1-ee88-4776-b348-8cabee19914a admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:37.065544 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.wsgi [None req-6a14d2b1-ee88-4776-b348-8cabee19914a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-6a14d2b1-ee88-4776-b348-8cabee19914a admin admin] Request method failure captured: Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Accept: application/json Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Accept-Encoding: gzip, deflate Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Connection: keep-alive Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Content-Length: 0 Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Host: 10.222.0.13 Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Openstack-Api-Version: compute 2.90 Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Openstack-System-Scope: None Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: User-Agent: python-novaclient Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Auth-Token: gAAAAABingwIT_m9pnZBwS1xu5dnSNxgO6cmUGPM8TSRN7d4jvXR8DrekReueqMBMokeDDJVAZKX4OmYe8QC6OvreMqLTu8mo67t7q_frY80w2xzNdMUyzcjwnzRI8DAgW4k9YmuEZfzoQBeJfUVV3pjix-O7-zCOQhKYavYcvdjrQSo_GQXTdY Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Domain-Id: None Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Domain-Name: None Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Identity-Status: Confirmed Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Is-Admin-Project: True Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Domain-Id: default Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Domain-Name: Default Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Project-Name: admin Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Role: member,reader,admin Jun 06 14:15:37.067079 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Roles: member,reader,admin Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258fdfe108b84b6c82c61b2a2990c11d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}] Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant: admin Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-Tenant-Name: admin Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User: admin Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Domain-Id: default Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Domain-Name: Default Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Id: e2d188b242aa4be3ac73c99d08c98dbe Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: X-User-Name: admin Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: method: > Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: exception: Flavor 451 could not be found. Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: action_args: {'id': '451'} Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:15:37.068640 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:37.069542 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.071347 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-6a14d2b1-ee88-4776-b348-8cabee19914a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:15:37.072741 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-6a14d2b1-ee88-4776-b348-8cabee19914a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064884 Jun 06 14:15:37.072741 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 14:15:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 14:15:37.083319 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9aa97fa6-ef9b-44ed-b4c6-ccb9f0cc9fa1 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:37.111121 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9aa97fa6-ef9b-44ed-b4c6-ccb9f0cc9fa1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034609 Jun 06 14:15:37.112197 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 14:15:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:15:37.126052 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:37.141125 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018772 Jun 06 14:15:37.141682 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 14:15:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:15:37.155487 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-74477ad0-34f8-40f4-8c9e-7537eb4c2427 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:37.166423 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-74477ad0-34f8-40f4-8c9e-7537eb4c2427 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-74477ad0-34f8-40f4-8c9e-7537eb4c2427 admin admin] Request method failure captured: Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Accept: application/json Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Connection: keep-alive Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Content-Length: 0 Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Host: 10.222.0.13 Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABingwIT_m9pnZBwS1xu5dnSNxgO6cmUGPM8TSRN7d4jvXR8DrekReueqMBMokeDDJVAZKX4OmYe8QC6OvreMqLTu8mo67t7q_frY80w2xzNdMUyzcjwnzRI8DAgW4k9YmuEZfzoQBeJfUVV3pjix-O7-zCOQhKYavYcvdjrQSo_GQXTdY Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Role: member,reader,admin Jun 06 14:15:37.169548 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Roles: member,reader,admin Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/258fdfe108b84b6c82c61b2a2990c11d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_258fdfe108b84b6c82c61b2a2990c11d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/258fdfe108b84b6c82c61b2a2990c11d"}]}] Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant: admin Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 258fdfe108b84b6c82c61b2a2990c11d Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User: admin Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Id: e2d188b242aa4be3ac73c99d08c98dbe Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: X-User-Name: admin Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: method: > Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: exception: Flavor 451 could not be found. Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: action_args: {'id': '451'} Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:15:37.171267 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:37.172218 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 06 14:15:37.173465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-74477ad0-34f8-40f4-8c9e-7537eb4c2427 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:15:37.174516 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-74477ad0-34f8-40f4-8c9e-7537eb4c2427 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.023755 Jun 06 14:15:37.174516 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 14:15:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 14:15:38.070378 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:38.072072 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003170 Jun 06 14:15:38.072568 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:38 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:38.269248 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-cf0b50ff-ad86-47ae-b41f-167991a16a70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:38.290702 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-cf0b50ff-ad86-47ae-b41f-167991a16a70 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.077767 Jun 06 14:15:38.291179 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 14:15:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:39.204553 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:39.206434 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002582 Jun 06 14:15:39.207183 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:39.412146 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-1854c9bf-7d09-425f-89f7-40fdd37670c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:39.431968 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-1854c9bf-7d09-425f-89f7-40fdd37670c0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074723 Jun 06 14:15:39.432522 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 14:15:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:40.322359 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:40.323375 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 06 14:15:40.323806 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:40.528965 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-19b19767-c8ef-4c9f-adb0-6895773b0aee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:40.554856 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-19b19767-c8ef-4c9f-adb0-6895773b0aee admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.091485 Jun 06 14:15:40.555743 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 14:15:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:41.480299 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:41.481300 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 06 14:15:41.481694 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:41.683655 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3fa0fabf-78d1-4779-8559-c10b5094dbae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:15:41.703800 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3fa0fabf-78d1-4779-8559-c10b5094dbae admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075041 Jun 06 14:15:41.704273 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 14:15:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:15:42.613572 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:42.614961 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001819 Jun 06 14:15:42.615358 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:15:42.817659 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-eaf1d05e-a2d6-4f91-a267-42dcb61548ca admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:15:42.837134 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-eaf1d05e-a2d6-4f91-a267-42dcb61548ca admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075496 Jun 06 14:15:42.837696 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Jun 6 14:15:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:16:45.873516 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:16:45.874577 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-94541f95-b32b-47cf-af74-8b3450fef084 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 06 14:16:45.874980 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 14:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:16:45.887143 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:16:45.940414 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-fc8e7348-c747-44bb-a9ba-d95565b200e4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:16:45.960195 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-fc8e7348-c747-44bb-a9ba-d95565b200e4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074466 Jun 06 14:16:45.960742 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 14:16:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:16:45.982269 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG dbcounter [-] [103169] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:16:45.986239 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-8616643e-1e21-4b4f-bad6-0df8b5aa3133 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:16:45.995951 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-8616643e-1e21-4b4f-bad6-0df8b5aa3133 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015409 Jun 06 14:16:45.996520 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jun 6 14:16:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:16:46.011491 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-61e4b206-a6de-40af-a759-559463c33562 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:16:46.019234 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-61e4b206-a6de-40af-a759-559463c33562 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011390 Jun 06 14:16:46.019912 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jun 6 14:16:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:16:46.031974 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:16:46.040623 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012495 Jun 06 14:16:46.041172 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jun 6 14:16:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:16:46.053773 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3bb785a3-17cb-4cdc-b5e6-7d3929149684 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:16:46.061650 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3bb785a3-17cb-4cdc-b5e6-7d3929149684 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012386 Jun 06 14:16:46.062157 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jun 6 14:16:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:20:04.768619 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:04.769618 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 06 14:20:04.770043 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:20:04.933998 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=6 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:20:05.060659 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6093b1c3-4a8d-4b52-9941-4722f1ba9bcd admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:05.061883 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:20:05.061883 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 06 14:20:05.063815 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-6093b1c3-4a8d-4b52-9941-4722f1ba9bcd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:05.064255 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-6093b1c3-4a8d-4b52-9941-4722f1ba9bcd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:05.065048 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-6093b1c3-4a8d-4b52-9941-4722f1ba9bcd admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:05.065472 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-6093b1c3-4a8d-4b52-9941-4722f1ba9bcd admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:05.100028 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6093b1c3-4a8d-4b52-9941-4722f1ba9bcd admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.171005 Jun 06 14:20:05.100600 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 14:20:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:20:06.007963 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:06.008952 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 06 14:20:06.009344 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:20:06.201724 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-8c32fd1d-963c-4ea9-96e8-a4c6469ca3f7 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:06.202893 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:20:06.202893 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 06 14:20:06.204861 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8c32fd1d-963c-4ea9-96e8-a4c6469ca3f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:06.205297 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8c32fd1d-963c-4ea9-96e8-a4c6469ca3f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:06.206147 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8c32fd1d-963c-4ea9-96e8-a4c6469ca3f7 admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:06.206569 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8c32fd1d-963c-4ea9-96e8-a4c6469ca3f7 admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:06.226362 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-8c32fd1d-963c-4ea9-96e8-a4c6469ca3f7 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076818 Jun 06 14:20:06.226913 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 14:20:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:20:17.546662 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:17.547669 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 06 14:20:17.548065 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:20:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:20:17.693815 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:20:17.694524 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:20:17.695131 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=8 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:20:17.745255 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-8545f687-3994-449a-8148-8cff78f4c772 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:17.746465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:20:17.746465 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 06 14:20:17.747662 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8545f687-3994-449a-8148-8cff78f4c772 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:17.748101 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8545f687-3994-449a-8148-8cff78f4c772 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:17.748892 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8545f687-3994-449a-8148-8cff78f4c772 admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:17.749321 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-8545f687-3994-449a-8148-8cff78f4c772 admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:17.775018 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-8545f687-3994-449a-8148-8cff78f4c772 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085559 Jun 06 14:20:17.775605 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 14:20:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:20:18.662362 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: DEBUG nova.api.openstack.wsgi [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] Calling method '>' {{(pid=103169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:18.663379 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: INFO nova.api.openstack.requestlog [None req-67984a02-a1c6-42e3-b8bd-1dbc8f47ff98 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 06 14:20:18.663778 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: [pid: 103169|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 14:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:20:18.865834 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-cc22ada2-55cf-4cc0-b4d0-879f95e22989 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:20:18.866990 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 14:20:18.866990 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 06 14:20:18.868187 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-cc22ada2-55cf-4cc0-b4d0-879f95e22989 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:18.868623 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-cc22ada2-55cf-4cc0-b4d0-879f95e22989 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:18.869407 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-cc22ada2-55cf-4cc0-b4d0-879f95e22989 admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:20:18.869859 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-cc22ada2-55cf-4cc0-b4d0-879f95e22989 admin admin] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:20:18.893043 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-cc22ada2-55cf-4cc0-b4d0-879f95e22989 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087514 Jun 06 14:20:18.893598 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 14:20:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:21:18.085935 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: Mon Jun 6 14:21:18 2022 - graceful shutdown triggered... Jun 06 14:21:18.086523 dv-cinder-844140-2-iscsi devstack@n-api.service[103169]: Gracefully killing worker 1 (pid: 103169)... Jun 06 14:21:18.086068 dv-cinder-844140-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 06 14:21:18.087566 dv-cinder-844140-2-iscsi devstack@n-api.service[103170]: Gracefully killing worker 2 (pid: 103170)... Jun 06 14:21:19.087061 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: worker 1 buried after 1 seconds Jun 06 14:21:19.087061 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: worker 2 buried after 1 seconds Jun 06 14:21:19.087061 dv-cinder-844140-2-iscsi devstack@n-api.service[103168]: goodbye to uWSGI. Jun 06 14:21:19.088657 dv-cinder-844140-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 06 14:21:19.089232 dv-cinder-844140-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 06 14:21:19.092052 dv-cinder-844140-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 14:21:19.102200 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 14:21:19.121920 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 14:21:19 2022] *** Jun 06 14:21:19.121920 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 14:21:19.121920 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: nodename: dv-cinder-844140-2-iscsi Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: machine: x86_64 Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: clock source: unix Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: pcre jit disabled Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: detected number of CPU cores: 4 Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: current working directory: / Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: detected binary path: /usr/bin/uwsgi-core Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: your processes number limit is 47680 Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: your memory page size is 4096 bytes Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: detected max file descriptor number: 2048 Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: lock engine: pthread robust mutexes Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: thunder lock: enabled Jun 06 14:21:19.122928 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 14:21:19.124386 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 14:21:19.170035 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: Python main interpreter initialized at 0x55f70345e9c0 Jun 06 14:21:19.170035 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: python threads support enabled Jun 06 14:21:19.170035 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: your server socket listen backlog is limited to 100 connections Jun 06 14:21:19.170035 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: your mercy for graceful operations on workers is 90 seconds Jun 06 14:21:19.170472 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 14:21:19.170472 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: *** Operational MODE: preforking *** Jun 06 14:21:19.170862 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: *** uWSGI is running in multiple interpreter mode *** Jun 06 14:21:19.170862 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: spawned uWSGI master process (pid: 117581) Jun 06 14:21:19.171000 dv-cinder-844140-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 14:21:19.174046 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: spawned uWSGI worker 1 (pid: 117603, cores: 1) Jun 06 14:21:19.174403 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: spawned uWSGI worker 2 (pid: 117604, cores: 1) Jun 06 14:21:19.174759 dv-cinder-844140-2-iscsi devstack@n-api.service[117581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 14:21:20.444382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 14:21:20.484949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 14:21:21.288471 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:21:21.288471 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: from cryptography.utils import int_from_bytes Jun 06 14:21:21.288830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:21:21.288830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: from cryptography.utils import int_from_bytes Jun 06 14:21:21.368430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:21:21.368430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: from cryptography.utils import int_from_bytes Jun 06 14:21:21.368723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 14:21:21.368723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: from cryptography.utils import int_from_bytes Jun 06 14:21:23.777567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 14:21:23.778276 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 14:21:23.778686 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 14:21:23.779073 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 14:21:23.779329 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 14:21:23.779741 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.780088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.780411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.780749 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.781078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.781429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.781800 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.782146 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.782528 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.782803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.783212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.783534 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-2-iscsi {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.783898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.784235 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.784596 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.784939 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.785267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.785628 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.785963 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.786530 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.786999 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.787312 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.787661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.788222 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.788329 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.788651 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.788974 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.789299 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.789627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.790005 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.790417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-2-iscsi {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.790754 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.791125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.791431 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.791888 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.792231 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.792544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.792892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.793212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.794087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.794496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.794823 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.795175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.795486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.795788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.796097 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.796401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.796716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.797018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.797338 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.797565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.797897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.798216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.798534 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.798854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.799105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.799353 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.799669 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.799985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.800292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.800598 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.800902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.801285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.801551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.801909 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.802248 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.802556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.802939 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.803226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.803583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.803908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.804229 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.804652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.804923 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.805269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.805624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.805992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.806313 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.806664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.806985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.807292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.807620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.807935 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.808253 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.808593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.808901 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.809229 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.810123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.810447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.810769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.811113 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.811444 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.811769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.812090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.812417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.812744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.813074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.813379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.813724 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.814067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.814379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.814725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.815050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.815385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.815700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.816038 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.816347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.816649 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.816951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.817274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.817583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.817978 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.818309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.818620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.818932 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.819237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.819583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.819895 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.820214 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.820508 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.820811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.821128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.821431 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.821752 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.822056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.822358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.822659 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.822961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.823302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.823622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.823935 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.824252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.824580 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.824921 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.825247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.825630 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.826097 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.826477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.826815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.827195 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.827476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.827826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.828193 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.828611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.828848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.829186 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.829530 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.829885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.830220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.830622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.830962 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.831309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.831647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.831985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.832303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.832644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.832978 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.833330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.833662 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.834022 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.834334 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.834701 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.835041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.835375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.835721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.836065 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.836396 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.836745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.837074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.837425 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.837797 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.838138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.838454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.838790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.839103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.839457 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.839776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.840120 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.840984 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.841370 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.841888 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.842204 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.842547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.842876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.843189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.843519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.843842 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.844165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.844492 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.844827 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.845172 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.845515 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.845865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.846191 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.846553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.846877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.847187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.847497 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.847807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.848107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.848420 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.848726 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.849032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.849351 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.849661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.849991 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.850311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.850614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.850917 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.851235 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.851540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.851855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.852178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.852509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.852856 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.853179 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.853517 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.853861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.854243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.854553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.855136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.855498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.855813 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.856680 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.857022 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.857331 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.857631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.857996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.858307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.858631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.858959 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.859256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.859597 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.859919 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.860253 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.860568 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.860889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.861197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.861511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.861916 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.862229 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.862573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.862915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.863213 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.863533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.863845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.864161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.864469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.864776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.865086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.865400 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.865758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.866058 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.866377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.866716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.867017 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.867441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.867627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.867930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.868240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.868575 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.868887 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.869231 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.869538 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.869970 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.870197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.870567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.870983 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.871186 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.871479 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.871857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.872311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.872652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.872994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.873341 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.873651 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.874025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.874339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.874676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.875007 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.875363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.875707 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.876019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.876364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.876674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.877002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.877311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.877615 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.877950 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.878260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.878573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.878882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.879191 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.879494 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.879808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.880113 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.880431 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.880724 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.881038 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.881355 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.881666 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.882027 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.882347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.882650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.882953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.883271 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.883579 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.883881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.884185 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.884484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.884851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.885174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.885491 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.885831 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.886177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.886486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.886799 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.887105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.887555 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.887807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.888161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.888649 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.888985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.889436 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.889631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.890032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.890318 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.890629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.890947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.891291 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.891601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.891929 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.892264 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.892880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.893237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.893578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.893948 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.894288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.894630 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.894984 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.895343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.895700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.896091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.896406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.896714 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.897018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.898100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.898100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.898100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.898585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.898585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.898893 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.899199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.899502 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.899827 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.900180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.900493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.900898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.901216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.901567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.901930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.902300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.902638 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.903485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.903844 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.904292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.904766 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.905108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.905477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.905824 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.906162 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.906490 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.906810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.907156 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.907502 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.907820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.908169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.908493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.908825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.909166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.909493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.909859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.910169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.910512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.910836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.911152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.911484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.911807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.912123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.912432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.912760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.913081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.913407 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.913723 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.914068 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.914371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.914674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.915000 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.915328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.915637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.915978 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.916302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.916633 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.916937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.917266 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.917573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.917923 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.918257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.919168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.919528 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.919858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.920174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.920470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.920795 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.921117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.921438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.921779 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.922106 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.922406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.922750 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.923047 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.923350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.923712 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.924040 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.924361 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.924663 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.924983 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.925355 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.925658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.926060 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.926369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.926692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.927028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.927363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.927676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.927990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.928295 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.928606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.928916 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.929226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.929530 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.929870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.930257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.930569 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.930880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.931198 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.931516 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.931836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.932143 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.932448 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.932757 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.933063 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.933363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.933667 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.934008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.934358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.934665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.934976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.935289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.935593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.935904 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.936210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.936512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.936831 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.937139 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.937437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.937787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.938091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.938400 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.938722 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.939180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.939486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.939848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.940155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.940463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.940772 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.941086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.941399 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.941713 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.942154 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.942446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.942754 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.943062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.943362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.943661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.943969 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.944286 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.944586 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.944885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.945189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.945506 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.945829 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.946149 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.946562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.946867 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.947167 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.947576 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.947884 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.948188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.948507 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.948824 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.949142 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.949444 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.949807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.950124 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.950484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.950843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.951067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.951378 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.951736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.952000 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.952320 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.952652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.952990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.953401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.953743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.954048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.954367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.954692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.954996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.955297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.955605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.955904 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.956206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.956524 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.956828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.957128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.957434 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.957759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.958062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.958363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.958682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.958979 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.959302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.959613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.959930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.960246 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.960546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.960864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.961171 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.961468 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.961789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.962090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.962435 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.962756 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.963049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.963380 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.963700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.964006 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.964336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.964657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.964975 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.965289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.966180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.966507 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.966836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.967234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.967542 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.967845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.967952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 14:21:23.968418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.968508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 14:21:23.968595 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.968800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 14:21:23.968908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.969013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.969123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 14:21:23.969310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.969492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 14:21:23.969647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.969795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.969959 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.970060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.970279 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.970383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.970586 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.970696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.970891 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.971066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.971217 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.971370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.971520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.971681 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.971824 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.971973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.972120 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.972274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.972427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.972577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.972721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.972865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.973002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-2-iscsi {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.973200 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.973354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.973499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.973640 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.973814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.973936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.974043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.974255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.974358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.974586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.974696 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.974898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.974990 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.975200 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.975303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.975519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.975732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.975852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.976040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.976156 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.976343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.976464 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.976651 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.976777 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.976982 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.977086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.977294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.977387 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.977600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.977940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.978137 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.978249 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.978352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.978570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.978671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.978878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.979053 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.979186 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.979282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-2-iscsi {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.979501 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.979619 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.979810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.980168 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.980415 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.980663 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.981675 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.981820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.981913 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.982110 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.982249 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.982348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.982450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.982740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.982946 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.983055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.983152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.983374 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.983505 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.983700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.983802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.984033 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.984140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.984329 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.984439 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.984643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.984736 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.984950 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.985056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.985259 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.985362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.985568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.985670 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.985911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.986095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.986224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.986335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.986522 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.986630 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.986771 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.986876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.987143 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.987259 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.987398 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.987715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.987715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.987895 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.988014 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.988110 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.988262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.988357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.988510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.988619 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.988827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.988945 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.989149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.989265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.989454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.989564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.989783 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.989903 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.990090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.990186 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.990394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.990490 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.990699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.990801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.991005 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.991277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.991401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.991735 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.991893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.991893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.992064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.992277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.992368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.992516 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.992611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.992824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.993023 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.993130 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.993217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.993445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.993617 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.993798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.993897 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.994067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.994165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.994377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.994517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.994681 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.994777 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.994980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.995078 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.995301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.995396 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.995608 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.995719 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.995908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.996010 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.996210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.996304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.996516 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.996708 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.996965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.997073 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.997403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.997634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.997803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.997906 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.998049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.998144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.998369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.998471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.998684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.998803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.998987 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.999091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.999311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.999418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.999611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:23.999705 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:23.999917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.000023 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.000215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.000319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.000567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.000684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.000911 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.001124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.001224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.001319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.001419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.001514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.001711 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.001808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.002023 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.002128 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.002327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.002429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.002628 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.002730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.002932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.003111 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.003240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.003331 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.003546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.003679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.003848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.003966 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.004147 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.004249 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.004443 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.004535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.004743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.004847 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.005045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.005141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.005348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.005451 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.005649 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.005772 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.005974 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.006085 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.006279 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.006376 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.006577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.006670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.006885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.007002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.007188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.007359 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.007509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.007653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.007808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.007968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.008115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.008260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.008410 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.008562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.008707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.008864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.009009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.009153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.009250 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.009482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.009645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.009850 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.009971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.010068 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.010163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.010251 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.010419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.010625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.010781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.010930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.011074 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.011293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.011447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.011638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.011784 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.011934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.012086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.012231 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.012343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.012630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.012793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.012994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.013160 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.013376 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.013557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 14:21:24.013739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.013849 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014023 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014646 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014828 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.014966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.015163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.015279 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.015497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.015603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.015819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.015920 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.016133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.016241 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.016438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.016540 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.016746 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.016856 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017158 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017533 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017683 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.017992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.018166 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.018332 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.018489 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.018630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.018773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.018926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.019079 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.019222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.019464 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.019564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.019647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.019855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.020979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021421 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021578 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021762 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021863 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.021966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.022071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.022193 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.022313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.022613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.022724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.022922 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.023025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.023234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.023364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.023544 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.023653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.023852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024010 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024167 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024583 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.024893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.025103 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.025198 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.025414 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.025507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.025756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.025864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.026043 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.026153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.026354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.026478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.026691 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.026794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.027008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.027103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.027325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.027433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.027638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.027753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.028485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.028593 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.028852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.029015 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.029228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.029558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.029667 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.029855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.029965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.030170 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.030354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.030543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.030713 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.030944 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031093 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031238 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031678 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031824 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.031974 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.032130 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.032351 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.032500 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.032599 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.032742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.032893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033513 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033775 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.033995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034379 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034522 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034687 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.034983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.035121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.035313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.035449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.035624 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.035784 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.035949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.036098 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.036256 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.036416 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.036561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.036723 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.036865 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.037039 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.037179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.037347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.037491 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.037672 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.037826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.038016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.038128 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.038332 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.038428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.038674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.038780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039112 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039623 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.039936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040591 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040900 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.040989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.041174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.041316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.041459 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.041626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.041786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.041892 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042480 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042674 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.042983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.043087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.043286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.043403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.043752 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.043894 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.043988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.044208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.044319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.044548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.044643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.044859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.044961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.045187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.045290 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.045498 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.045599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.045827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.045928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.046133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.046246 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.046438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.046542 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.046779 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.046873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.047087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.047182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.047408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.047502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.047758 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.047850 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.048054 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.048156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.048375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.048469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.048688 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.048790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049097 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049409 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049733 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.049882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 14:21:24.050147 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.050303 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.050572 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.050886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.051210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.051569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.051844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.052156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.052477 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.052782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.053099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.053440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.053789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.054107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.054427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.054739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.055055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.055371 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.055679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.055988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.056299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.056616 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.056930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.057251 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.057557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.057917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.058229 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.058548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.058850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.059797 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.060262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.060645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.060989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.061305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.061631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.061999 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.062313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.062626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.062934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.063242 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.063612 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.063866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.064179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.064495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.064799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.065118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.065426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.065768 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.066075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.066385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.066706 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.067017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.067337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.067655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.067956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.068262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.068580 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.068887 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.069190 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.069494 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.069818 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.070165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.070475 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.070782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.071097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.071423 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.071729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.072040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.072347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.072653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.072973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.073285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.073592 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.073955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.074239 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.074549 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.075043 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.075423 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.075829 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.076145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.076459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.076764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.077075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.077394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.077998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.078332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.078648 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.078987 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.079286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.079605 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.079935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.080263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.080619 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.080927 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.081236 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.081541 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.081866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.082180 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.082483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.082788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.083090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.083397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.083699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.084004 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.084306 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.084608 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.084920 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.085223 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.085533 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.085863 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.086187 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.086496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.086798 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.087101 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.087402 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.087742 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.088045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.088382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.088710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.089048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.089378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.089683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.090108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.090897 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.091402 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.091759 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.092080 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.092394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.092698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.093009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.093319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.093632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.093971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.094272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.094583 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.094885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.095199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.095510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.095818 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.096165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.096434 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.096740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.097054 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.101976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.102634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.102976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.103322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.103663 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.103995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.104316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.104635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.105217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.105531 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.105870 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.106734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.107280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.107724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.108037 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.108347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.108659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.108988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.109304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.109620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.109955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.110264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.110618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.110926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.111302 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.111454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Registered counter for database nova_api Jun 06 14:21:24.111609 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.111903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.112224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.112537 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.112855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.113169 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.113476 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.113821 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.114132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.114452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.114757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.115063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.115387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.115699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.116018 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.116341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.116664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.116987 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.117292 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.117603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.117936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.118250 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.118562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.118873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.119185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.119499 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.119814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.120128 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.120441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.120752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.121062 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.121371 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.121813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.122325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.122751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.123064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.123380 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.123689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.124017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.124326 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.125603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.125603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.125603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.125878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.127230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.127230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.127230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.127230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.127230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.127881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.128041 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.128259 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.128804 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.128946 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.129159 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.129477 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.129932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.130246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.130569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.130878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.131190 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.131478 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.131801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.131934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.132263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.132535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.133033 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.133270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.133579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.133916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.134246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.134567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.134903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.135209 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.135541 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.135856 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.136178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.136499 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.136809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.137123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.137463 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.137889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.138471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.138910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.139241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.139454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.139665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.139993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.140308 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.140634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.140964 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.141272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.141576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.141922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.142231 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.142539 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.142860 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.143165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.143476 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.143785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.144094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.144398 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.144703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.145023 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.145329 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.145650 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.145992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.146315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.146639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.146945 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.147266 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.147808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.147918 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.148165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.148459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.148800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.149110 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.149426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.149778 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.150110 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.150419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.150783 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.151081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.151395 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.151715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.152168 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.152346 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.152769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.153515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.154152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.154583 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.154905 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.155217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.155525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.155835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.156142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.156474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.156782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.157108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.157419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.157813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.158053 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.158420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.158700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.159007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.159342 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.159665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.159985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.160313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.160622 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.160944 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.161261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.161599 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.161943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.162264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.162581 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.162928 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.163232 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.163545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.163862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.164178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.164497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.165059 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.165385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.165726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.166035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.166355 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.166666 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.166979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.167291 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.167602 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.167914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.168224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.168641 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.169681 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.170173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.170408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.170727 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.171044 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.171356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.171683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.172044 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.172358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.172677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.173012 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.173316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.173634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.173972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.174285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.174601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.174913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.175311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.175576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.175889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.176204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.176544 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.176896 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.177228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.177542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.177879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.178199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.178742 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.179056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.179389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.179715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.180060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.180451 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.180701 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.181046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.181366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.181729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.182087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.182375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.182680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.183151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.183314 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.183620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.183943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.184347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.185280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.185641 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.185992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.186332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.186661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.186984 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.187297 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.187623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.187934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.188241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.188558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.188871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.189178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.189481 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.189814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.190126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.190432 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.190741 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.191046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.191373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.191680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.191985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.192289 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.192599 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.192903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.193207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.193514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.193837 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.194152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.194456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.194764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.195066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.195376 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.195681 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.195988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.196344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.196667 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.196971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.197270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.197590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.197924 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.198245 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.198559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.198867 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.199213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.199529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.200692 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.201294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.201631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.202000 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.202336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.202651 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.202960 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.203099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.context [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26f43c31-b475-46bf-a782-cf1fcb4532b4(cell1) {{(pid=117604) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 14:21:24.203270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.203595 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.203907 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.204216 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.204542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.204869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.205155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.208859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:21:24.209449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:21:24.209952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.209952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.210328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:21:24.210412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.210412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.210684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.210919 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.211248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.211561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.211864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:21:24.211963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.212286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.212596 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.212913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.213235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.213545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.213938 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Registered counter for database nova_cell0 Jun 06 14:21:24.214057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.214325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.214636 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.214973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.215262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.216343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.216908 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.217389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.217751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.218050 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.218360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.218673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.218983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.219306 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.219618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.219941 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.220226 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.220345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Registered counter for database nova_cell1 Jun 06 14:21:24.220538 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.220844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.221149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.221452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.221793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.222106 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.222409 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.222713 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.223015 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.223321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.223618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.223923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.224279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.224534 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.224925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.225142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.225447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.225796 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.226105 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.226436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.226756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.227075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.227387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.227707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.227925 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.228055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.228327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.228649 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.228970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.229279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.229612 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.230214 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.230454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.230571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.230830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.231689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.232011 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.232393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.232813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.233058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.233367 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.233696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.234155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.234365 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.234685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.235002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.235337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.235647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.235957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.236280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.236612 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.236929 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.237253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.237571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.237824 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.239050 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.239253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.239618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.239801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.240118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.240439 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.240599 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.240888 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.245748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.245748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.245748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.245748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.245748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 14:21:24.245748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 14:21:24.306934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO dbcounter [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Registered counter for database nova_api Jun 06 14:21:24.327673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.335319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writer thread running {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.395886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.context [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),26f43c31-b475-46bf-a782-cf1fcb4532b4(cell1) {{(pid=117603) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 14:21:24.396474 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Registered counter for database nova_cell0 Jun 06 14:21:24.400298 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:21:24.401984 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:21:24.403047 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:21:24.405228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.405683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:21:24.407904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO dbcounter [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Registered counter for database nova_cell0 Jun 06 14:21:24.413613 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO dbcounter [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Registered counter for database nova_cell1 Jun 06 14:21:24.415026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.422567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.424497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.432711 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writer thread running {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.434505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writer thread running {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.588133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO dbcounter [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Registered counter for database nova_cell0 Jun 06 14:21:24.596184 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 14:21:24.601801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writer thread running {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 14:21:24.866999 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:21:24.875773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:21:25.065347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:21:25.072721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:21:25.114687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:21:25.120844 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-269aed26-9018-4662-9bad-95a0fad2fd19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:21:25.126810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f70345e9c0 pid: 117604 (default app) Jun 06 14:21:25.297430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 14:21:25.303472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-66c03885-b81b-48e2-b2b8-26bd4a4d0420 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 14:21:25.308731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f70345e9c0 pid: 117603 (default app) Jun 06 14:22:11.849068 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:11.852503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:11.858725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:11.861461 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:13.583794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-77b2d947-f682-4175-bdb9-fa313532f5ab tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Action: 'create', calling method: .version_select at 0x7fae90ec25e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-557751479", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:14.245940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e86d70d9-efa1-4fe1-8a81-730a10919cf6 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90ff61f0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:14.428900 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:14.434822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:14.437616 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:14.439016 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:15.060523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e86d70d9-efa1-4fe1-8a81-730a10919cf6 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ae141b7f-7144-4dad-8397-6cf74b4874da" status: 200 len: 350 microversion: 2.1 time: 1.646146 Jun 06 14:22:15.062146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:13 2022] GET /compute/v2.1/os-volumes/ae141b7f-7144-4dad-8397-6cf74b4874da => generated 350 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:15.662602 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-77b2d947-f682-4175-bdb9-fa313532f5ab tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.821191 Jun 06 14:22:15.664065 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 14:22:11 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 14:22:15.695764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1c20d32a-2712-4d16-ab4e-ce8fe72e53c0 tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Calling method '.version_select at 0x7fae90dcf5e0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:15.985650 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1c20d32a-2712-4d16-ab4e-ce8fe72e53c0 tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124" status: 200 len: 352 microversion: 2.1 time: 0.304797 Jun 06 14:22:15.991619 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:15 2022] GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 => generated 352 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:22:16.460455 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1245908129", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "networks": [{"uuid": "fa6b286e-5107-4398-8415-51d8223e7f8f"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:16.821022 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] validate_networks() for [('fa6b286e-5107-4398-8415-51d8223e7f8f', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:22:17.016756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f241c514-cbc9-4a55-a576-09bb0b2c505a tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Calling method '.version_select at 0x7fae90dcf670>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:17.133999 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f241c514-cbc9-4a55-a576-09bb0b2c505a tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124" status: 200 len: 353 microversion: 2.1 time: 0.137599 Jun 06 14:22:17.134753 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:16 2022] GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:17.152429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a8613592-1df1-4f07-8fb9-da44ffbc6129 tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Calling method '.version_select at 0x7fae90dcfd30>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:17.419751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a8613592-1df1-4f07-8fb9-da44ffbc6129 tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124" status: 200 len: 353 microversion: 2.1 time: 0.271003 Jun 06 14:22:17.421091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 4/5] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:17 2022] GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 => generated 353 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:22:17.433868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-74b6d263-55fa-49e2-83f3-c25516c4da76 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90d8e430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:17.603275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-74b6d263-55fa-49e2-83f3-c25516c4da76 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ae2215ee-8f60-42db-ae02-dfe930cfdbab" status: 200 len: 350 microversion: 2.1 time: 0.180030 Jun 06 14:22:17.616055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 5/6] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:17 2022] GET /compute/v2.1/os-volumes/ae2215ee-8f60-42db-ae02-dfe930cfdbab => generated 350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:17.629426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b0c0e638-143c-47e4-ba01-d78a96664b6c tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Calling method '.version_select at 0x7fae90dcfca0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:17.850855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b0c0e638-143c-47e4-ba01-d78a96664b6c tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124" status: 202 len: 0 microversion: 2.1 time: 0.232132 Jun 06 14:22:17.852411 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 6/7] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:22:17 2022] DELETE /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:22:17.870771 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-17fdc645-a0af-4bf0-94c1-9dcd67c340db tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Calling method '.version_select at 0x7fae90dcf790>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:18.186162 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-17fdc645-a0af-4bf0-94c1-9dcd67c340db tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124" status: 200 len: 352 microversion: 2.1 time: 0.326489 Jun 06 14:22:18.188630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 7/8] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:17 2022] GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 => generated 352 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:19.205429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1e3ad264-7d37-40e4-9124-d6d93f4940ee tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Calling method '.version_select at 0x7fae90d8e670>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:19.237690 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-1e3ad264-7d37-40e4-9124-d6d93f4940ee tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] HTTP exception thrown: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1e3ad264-7d37-40e4-9124-d6d93f4940ee tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Request method failure captured: Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 HTTP/1.1 Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2TcttPaMzLEX6NQwWdJ6AXd9bnsfszH27DhJl3zkE0BJ53haS2Sv1ripxcxz4h55Vuhkx7C1mHLky3kwhICLLpfnZ5NqpmSoBGeyW97b6N_reW2nL1t7VphXlnGanMVzZUlB-QrF-YhtUbphuQBSLjhJ4S1R81IxOvINWiV5aeFzc Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 7f970147e5094c01bacf052bbc47c129 Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesGetTestJSON-1517295955 Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:22:19.242163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f970147e5094c01bacf052bbc47c129"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7f970147e5094c01bacf052bbc47c129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7f970147e5094c01bacf052bbc47c129", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7f970147e5094c01bacf052bbc47c129"}]}] Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesGetTestJSON-1517295955 Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 7f970147e5094c01bacf052bbc47c129 Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesGetTestJSON-1517295955 Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesGetTestJSON-1517295955-project Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 7c73fcf874e2461e920859b5c3ee6599 Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesGetTestJSON-1517295955-project Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'eaa0daf0-065b-4f4e-8ab8-496243025124'} Jun 06 14:22:19.243228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. (HTTP 404) (Request-ID: req-a7893589-c84b-45f9-8cc9-76563d7839dc) Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:22:19.243910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:22:19.245332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 14:22:19.246333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. Jun 06 14:22:19.247204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:22:19.249700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1e3ad264-7d37-40e4-9124-d6d93f4940ee tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] Returning 404 to user: Volume eaa0daf0-065b-4f4e-8ab8-496243025124 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:22:19.250885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1e3ad264-7d37-40e4-9124-d6d93f4940ee tempest-VolumesGetTestJSON-1517295955 tempest-VolumesGetTestJSON-1517295955-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124" status: 404 len: 109 microversion: 2.1 time: 0.049471 Jun 06 14:22:19.252691 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 8/9] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:19 2022] GET /compute/v2.1/os-volumes/eaa0daf0-065b-4f4e-8ab8-496243025124 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:22:19.782131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9954e07e-5117-4988-a433-33ed8ff81a6f tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90dcf8b0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:19.986592 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9954e07e-5117-4988-a433-33ed8ff81a6f tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e9838daa-4948-4528-afee-90a2af6b1695" status: 200 len: 351 microversion: 2.1 time: 0.211907 Jun 06 14:22:20.001651 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 9/10] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:22:19 2022] GET /compute/v2.1/os-volumes/e9838daa-4948-4528-afee-90a2af6b1695 => generated 351 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:20.012696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fe0ca51f-93d0-447f-ab4a-bc998bbf4066 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90cfa430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:20.189972 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:22:20.191097 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:22:20.191621 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:22:20.192034 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:22:20.192478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:22:20.216913 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:20.217359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:20.222946 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:20.223627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:20.331808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Getting quotas for project c2ab6d13d539433a853fc6805d819b85. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:20.350859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Getting quotas for user a5fee90ee6694ae4a821f60ca194ce84 and project c2ab6d13d539433a853fc6805d819b85. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:20.377453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:22:20.383914 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:22:20.448268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fe0ca51f-93d0-447f-ab4a-bc998bbf4066 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.444707 Jun 06 14:22:20.450927 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 10/11] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jun 6 14:22:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:20.490913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a9a07eae-2373-46ba-a63c-3cbb14bdc034 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae91771700>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:20.665232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4d3d2506-459b-47f0-9c56-4153e685fe3d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.548238 Jun 06 14:22:20.665933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 2/12] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:22:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:22:20.685604 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-085c61f7-aeba-4c0c-9afd-6b111e104eb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:20.686505 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-085c61f7-aeba-4c0c-9afd-6b111e104eb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:20.909175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a9a07eae-2373-46ba-a63c-3cbb14bdc034 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.441262 Jun 06 14:22:20.912513 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 11/13] 10.222.0.13 () {58 vars in 1148 bytes} [Mon Jun 6 14:22:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:22:20.939414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0fd0563d-2f5d-46b6-827f-5b866a2b1842 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90cfad30>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:21.222807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0fd0563d-2f5d-46b6-827f-5b866a2b1842 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.292526 Jun 06 14:22:21.235920 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 12/14] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jun 6 14:22:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:22:21.266089 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c6b756b5-4e8f-483c-80bb-24b3d2f3043a tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90d009d0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:21.437641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-085c61f7-aeba-4c0c-9afd-6b111e104eb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:21.468545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-085c61f7-aeba-4c0c-9afd-6b111e104eb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1215 microversion: 2.1 time: 0.787745 Jun 06 14:22:21.472616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 3/15] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:20 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1215 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:22:21.651059 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c6b756b5-4e8f-483c-80bb-24b3d2f3043a tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.411109 Jun 06 14:22:21.674517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 13/16] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Jun 6 14:22:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:21.696341 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e480fae9-a5dc-4e6a-b5d1-24713eaa3cd3 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90d8ca60>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:22.140117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e480fae9-a5dc-4e6a-b5d1-24713eaa3cd3 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.466157 Jun 06 14:22:22.143145 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 4/17] 10.222.0.13 () {58 vars in 1169 bytes} [Mon Jun 6 14:22:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:22.166703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f885364e-f351-4318-a672-a9bc444f1ea5 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90d00700>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:22.383958 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f885364e-f351-4318-a672-a9bc444f1ea5 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.220865 Jun 06 14:22:22.384914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 14/18] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jun 6 14:22:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:22.403368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fe56f060-741b-418d-88fc-320390959383 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90454ca0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:22.514499 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-82773842-a2d0-43d2-862b-11523efad305 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:22.519543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-82773842-a2d0-43d2-862b-11523efad305 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:22.659557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fe56f060-741b-418d-88fc-320390959383 tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.265742 Jun 06 14:22:22.672433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 5/19] 10.222.0.13 () {58 vars in 1187 bytes} [Mon Jun 6 14:22:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:22.675976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7de058ee-9238-42c7-9c1f-53583e09e1bc tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] Calling method '.version_select at 0x7fae90461940>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:22.825520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7de058ee-9238-42c7-9c1f-53583e09e1bc tempest-VolumesTestJSON-1869038793 tempest-VolumesTestJSON-1869038793-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.153615 Jun 06 14:22:22.827169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 6/20] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jun 6 14:22:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:22:22.973571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-82773842-a2d0-43d2-862b-11523efad305 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:23.025310 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-82773842-a2d0-43d2-862b-11523efad305 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1215 microversion: 2.1 time: 0.529352 Jun 06 14:22:23.031631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 15/21] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:22 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1215 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:24.067336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:24.079933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:24.124352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:24.129132 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:24.135436 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:24.144684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:25.060074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:25.103368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-234a0a92-07fc-48d1-83a6-f9d9aaf0e073 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1211 microversion: 2.1 time: 1.043810 Jun 06 14:22:25.115912 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 7/22] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:24 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1211 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:26.190683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:26.200850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:26.288145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:26.289073 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:26.295109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:26.300081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:27.587265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:27.651915 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1832a6d7-e628-455a-938a-db4518019994 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1273 microversion: 2.1 time: 1.521598 Jun 06 14:22:27.652570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 16/23] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:26 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1273 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:28.677620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:28.678323 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:28.700470 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:28.701440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:28.703629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:28.704054 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:29.071031 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4965d01d-8562-4b06-81e8-7ef4a2606e44 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: .version_select at 0x7fae903de4c0>, body: {"keypair": {"name": "tempest-keypair-2056073589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHAvzJPtKJap7W1XwYWQOVE3J/cocdpNn20CCoRRaZ2LXeG9Y4B4MsfsQ0PIloYTdqRWs7Fm/ndLauoGO4Wm1lbi8BmGiPy+XOmVtCV5mvELrrVTsv2UlFiYk3sl4CWMQ=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:29.139970 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-4965d01d-8562-4b06-81e8-7ef4a2606e44 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:29.149466 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-4965d01d-8562-4b06-81e8-7ef4a2606e44 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:29.231181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4965d01d-8562-4b06-81e8-7ef4a2606e44 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.236296 Jun 06 14:22:29.234614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 8/24] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:22:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:29.251780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:29.266087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a769af9-f0c3-4d21-8943-dad5053116a6 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1273 microversion: 2.1 time: 0.598816 Jun 06 14:22:29.269747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 17/25] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:28 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1273 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:22:30.282460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:30.311240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:30.315667 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:30.375254 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:30.375701 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:30.394084 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:30.394800 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:31.730072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:31.783664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0bc3559e-a452-4e88-8800-1d9f50afbf0f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 1.496575 Jun 06 14:22:31.803827 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 9/26] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:30 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:32.810448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:32.813530 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:32.830392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:32.831815 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:32.833969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:32.838484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:33.016134 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:34.320130 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:34.333810 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c156f3b2-a37a-4aca-b2de-494410a6a704 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 1.528073 Jun 06 14:22:34.340227 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 18/27] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:32 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:35.395857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:35.400102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:35.421843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:35.427854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:35.435316 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:35.438599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:39.179273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=12 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:40.176432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:40.229257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-769618cc-7cb9-4557-b10f-a3c35cce4a6d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 4.860126 Jun 06 14:22:40.277260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 10/28] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:35 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 4911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:22:40.655386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-34659acf-bccb-4693-9224-7a1c3dc617de tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'create', calling method: .version_select at 0x7fae90c125e0>, body: {"keypair": {"name": "tempest-keypair-1502505927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvnQGdKBg2aBekTk3EimeK8P1NZfKx2DrPb2vAQYWit8Xu8VpUPD5VcpKFuFGQ4HwEe9CzjgBdeYDBldRzmj0ertoSIgiojdU/OaBf3oxVk4kT8Z+nc/XWkZIEfSMu9og=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:41.145511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0931cf07-c912-41e8-80c0-36ea7a6466c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: .version_select at 0x7fae90343b80>, body: {"keypair": {"name": "tempest-keypair-1114144127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIpRh8rFefNUEK6pdmNAkcSoJ2jyRhC2dpCBnf0bAqDswIagi28+5zZmWhWbVJIj+f7UaSViwGHDwgelbtgOfPoEDgz3xx7eeioiYtCTaW9TrDcDbh+Hv6K9/wtwyMJTA=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:41.179557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-34659acf-bccb-4693-9224-7a1c3dc617de tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for project 52da965db3654006abddd5b40b0905c2. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:41.272715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-34659acf-bccb-4693-9224-7a1c3dc617de tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for user 405ac2f6c07545efaa818e10fc788c05 and project 52da965db3654006abddd5b40b0905c2. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:41.329099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-0931cf07-c912-41e8-80c0-36ea7a6466c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:41.384498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-0931cf07-c912-41e8-80c0-36ea7a6466c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for user 3f2e1c5d022c4bde9e76b8a933739557 and project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:41.594810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0931cf07-c912-41e8-80c0-36ea7a6466c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.311233 Jun 06 14:22:41.614120 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 11/29] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:22:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:41.633528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-34659acf-bccb-4693-9224-7a1c3dc617de tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 2.659062 Jun 06 14:22:41.636372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 19/30] 10.222.0.13 () {62 vars in 1199 bytes} [Mon Jun 6 14:22:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 2669 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 06 14:22:41.637036 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:41.642980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:41.668617 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:41.671804 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:41.674394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:41.676551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:43.551785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:43.556319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=25 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:43.558836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-85ed6062-fef9-472c-b51d-acd2bdc130a3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 1.942479 Jun 06 14:22:43.559460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:41 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:44.332744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=18 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:44.385769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-b0803824-7d03-4d48-8733-8c9c0fdb928d req-ad9f9c30-cb7e-4734-826e-82a4479b2d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "002b8024-221d-4fec-bba7-9b03a34d0280", "tag": "40879521-81e3-4f32-9106-3ea8a3757175"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:44.401873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b0803824-7d03-4d48-8733-8c9c0fdb928d req-ad9f9c30-cb7e-4734-826e-82a4479b2d92 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:44.402894 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b0803824-7d03-4d48-8733-8c9c0fdb928d req-ad9f9c30-cb7e-4734-826e-82a4479b2d92 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:44.428753 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-b0803824-7d03-4d48-8733-8c9c0fdb928d req-ad9f9c30-cb7e-4734-826e-82a4479b2d92 service nova] Creating event network-changed:40879521-81e3-4f32-9106-3ea8a3757175 for instance 002b8024-221d-4fec-bba7-9b03a34d0280 on hv-cinder-84414 Jun 06 14:22:44.430026 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b0803824-7d03-4d48-8733-8c9c0fdb928d req-ad9f9c30-cb7e-4734-826e-82a4479b2d92 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 14:22:44.431643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:44.432605 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:44.433976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:44.434789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:44.507546 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.compute.rpcapi [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 14:22:44.509970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 14:22:44.594287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:44.601141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5c3c28c8-d5bc-4096-aa24-4770e299a6f6 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452304 Jun 06 14:22:44.601639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:44.605228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 20/32] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:22:44.612553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:44.644950 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:44.646282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:44.648260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:44.649397 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:46.522661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:46.553731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d911adfe-a7f9-4fad-ba75-36e4e6782fd3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 1.967788 Jun 06 14:22:46.561330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 13/33] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:44 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:47.615659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:47.621603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:47.632564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:47.646008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:47.646823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:47.648959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:47.650789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:49.613429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:49.636277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4feaab29-dcd2-4f8a-aeed-8e108635228f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 2.047804 Jun 06 14:22:49.640343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 21/34] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:47 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:50.668417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:50.670280 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:50.682219 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:50.685012 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:50.689990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:50.691155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:51.340717 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-209752706", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:51.418694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=4 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:51.528359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:22:51.558694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] validate_networks() for [('da05c785-91e1-4374-8904-6d56e0757608', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:22:51.777011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:51.797058 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-debed4b4-d5e0-4f7c-88c4-8aeeaa4c391a tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 1.135404 Jun 06 14:22:51.809099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 14/35] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:50 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:52.177788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1293377132", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c80cddf-8aa7-4709-b4d4-0401b235b6d1"}], "security_groups": [{"name": "tempest-securitygroup--442055405"}], "key_name": "tempest-keypair-2056073589", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:52.403091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] validate_networks() for [('5c80cddf-8aa7-4709-b4d4-0401b235b6d1', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:22:52.914731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:22:52.916724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:22:52.917453 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:22:52.918078 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:22:52.920008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:22:52.942482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:52.943316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:52.944693 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:52.947509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:53.063561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:53.074067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for user 86f9bcac527c45d6bc81b70e26544924 and project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:53.124727 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:22:53.139882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:22:53.343071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ce19d4e4-b3dc-46de-8ea4-eecebc9a83fc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.272984 Jun 06 14:22:53.344372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 22/36] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:22:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 14:22:53.365226 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1660974829", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b65619dd-abf2-4bc8-afc9-54a8502ba090"}], "security_groups": [{"name": "tempest-securitygroup--1154829665"}], "key_name": "tempest-keypair-1502505927", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:53.886955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] validate_networks() for [('b65619dd-abf2-4bc8-afc9-54a8502ba090', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:22:54.171513 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:22:54.172417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:22:54.173217 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:22:54.189906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:22:54.190859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:22:54.317011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:54.325620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:54.327802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:54.338603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:54.444239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:54.473557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:54.532362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:22:54.538047 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:22:54.691301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f42ae009-6ae2-48de-8e6f-274c99444730 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.517997 Jun 06 14:22:54.700407 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 15/37] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:22:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 14:22:54.714877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:54.717924 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:54.735377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:54.737459 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:54.740500 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:54.742245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:55.281899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:55.291481 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e11905d9-4283-4d63-942d-8693e6e5da31 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.588668 Jun 06 14:22:55.292287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 16/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:54 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:55.322677 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1766030979", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8a2e4ba-03d2-4744-85c7-3c6508d2bd9d"}], "security_groups": [{"name": "tempest-securitygroup--795052989"}], "key_name": "tempest-keypair-1114144127", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:55.450214 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:22:55.450840 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:22:55.451275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:22:55.451884 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:22:55.452462 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:22:55.487179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:55.487679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:55.498390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:55.499028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:55.567236 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for project 52da965db3654006abddd5b40b0905c2. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:55.581209 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for user 405ac2f6c07545efaa818e10fc788c05 and project 52da965db3654006abddd5b40b0905c2. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:55.617455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:22:55.626525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:22:55.779347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-829e44a5-c297-4427-8227-35452afe37bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.430938 Jun 06 14:22:55.782822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 23/39] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jun 6 14:22:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 14:22:55.789974 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:55.791330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:55.855258 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:55.860658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:55.869958 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:55.870856 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:56.033520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] validate_networks() for [('e8a2e4ba-03d2-4744-85c7-3c6508d2bd9d', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:22:56.366024 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:56.419373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ce1acdf9-bcd1-490c-8a3d-e74af1e1ed5d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1217 microversion: 2.1 time: 0.634099 Jun 06 14:22:56.438078 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 24/40] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:55 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1217 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:56.455596 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:56.458190 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:56.486735 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:56.490536 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:56.492562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:56.493800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:56.804447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:56.820465 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-32d98fe0-7f00-446f-a60c-2d43fc5283c5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1246 microversion: 2.1 time: 0.379295 Jun 06 14:22:56.827093 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 25/41] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:56 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1246 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:56.853879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:56.861413 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:56.882928 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:56.886519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:56.890189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:56.896267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:57.222517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:57.246361 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:57.248722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:57.255012 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-04b8c5cf-1e10-4820-ba6b-1576a396852a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1286 microversion: 2.20 time: 0.419069 Jun 06 14:22:57.265034 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 26/42] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:22:56 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1286 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:22:57.280377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:57.284431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:57.311925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:57.322392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:57.331216 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:57.346677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:57.730148 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:57.750959 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:22:57.751815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:22:57.751988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:22:57.752427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:22:57.753237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:22:57.768083 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:57.768543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:57.769387 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:57.770039 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:57.787559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-687a7399-ea3d-4016-a7ed-c3f3d9a5c2ab tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.520700 Jun 06 14:22:57.800424 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 27/43] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:57 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:57.823917 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:57.837485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for user 3f2e1c5d022c4bde9e76b8a933739557 and project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:57.859795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1294758065", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:22:57.879794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:22:57.892614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:22:58.091680 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2301027a-8031-4ef8-b704-79360df76bfd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.787997 Jun 06 14:22:58.093304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 17/44] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:22:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:22:58.112180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:58.114310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:58.115829 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] validate_networks() for [('da05c785-91e1-4374-8904-6d56e0757608', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:22:58.134104 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:58.135557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:58.137515 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:58.139293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:58.584619 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:58.601793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dbfa31fa-c089-45e1-8325-6669a5cd80a9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1302 microversion: 2.1 time: 0.505100 Jun 06 14:22:58.617763 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 18/45] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:58 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1302 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:58.617763 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f2b58bff-d720-4608-93f5-dc2cc9d38ed2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:58.617763 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f2b58bff-d720-4608-93f5-dc2cc9d38ed2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:58.992322 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f2b58bff-d720-4608-93f5-dc2cc9d38ed2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:59.005172 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f2b58bff-d720-4608-93f5-dc2cc9d38ed2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1238 microversion: 2.1 time: 0.400629 Jun 06 14:22:59.006105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 19/46] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:58 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1238 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:59.024006 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:59.025188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:59.035987 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.036819 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.038817 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.040191 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.231975 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:59.245247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:59.251588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:59.255105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e72e4846-8710-4245-89ce-9542c9a9c272 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1334 microversion: 2.20 time: 0.235715 Jun 06 14:22:59.269108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 20/47] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:22:59 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1334 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:22:59.280817 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:59.283516 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:59.300562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.304322 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.305184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.305696 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.600808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:22:59.601548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:22:59.601671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:59.602484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:22:59.604968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:22:59.606063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:22:59.620242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-547139cc-5c9f-4e51-9b82-7175268473ea tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.349542 Jun 06 14:22:59.621143 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 21/48] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:59 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:59.638550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.639005 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.639821 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.640261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.642922 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:59.645444 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:22:59.661063 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.662117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.663578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:22:59.668580 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:22:59.709315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:22:59.716859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for user 86f9bcac527c45d6bc81b70e26544924 and project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:22:59.753371 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:22:59.757785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:22:59.856604 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:22:59.875244 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d0b42de-b64c-49a5-a6e1-919599a1e000 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.058141 Jun 06 14:22:59.881785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-69077088-8bff-4c54-ad8a-6c76c30ed5f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1312 microversion: 2.1 time: 0.250418 Jun 06 14:22:59.883030 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 28/49] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:22:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 2082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:22:59.898305 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 22/50] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:59 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:22:59.917529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-530ce319-97c2-4e87-bcf6-c6c881cc5350 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:22:59.920793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-530ce319-97c2-4e87-bcf6-c6c881cc5350 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:00.029240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:00.035076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:00.092499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.093367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.094953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.108322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-530ce319-97c2-4e87-bcf6-c6c881cc5350 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:00.126511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.147287 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-530ce319-97c2-4e87-bcf6-c6c881cc5350 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1222 microversion: 2.1 time: 0.255671 Jun 06 14:23:00.153262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 29/51] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:22:59 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:00.302167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:00.305107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:00.339624 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.341577 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.343094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.343932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.373631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:00.416697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f595ba16-fa97-4141-bf3e-15a2ebdb7342 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1242 microversion: 2.1 time: 0.391249 Jun 06 14:23:00.422748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 23/52] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:00 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1242 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:00.591997 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:00.622037 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:00.625486 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:00.628294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3ea2a6bc-1ef6-4049-897f-f80a4ec5958e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1334 microversion: 2.20 time: 0.355659 Jun 06 14:23:00.630132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 30/53] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:00 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1334 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:00.644934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:00.646776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:00.669881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.674166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.676690 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.680182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.922793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:00.923965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:00.969050 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.970433 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:00.972153 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:00.975673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:01.148066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:01.186411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c6fec17d-c5a6-42de-aa36-abbf2ffdc675 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.548307 Jun 06 14:23:01.192748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 24/54] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:00 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:01.222087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:01.224414 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:01.261659 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:01.262382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:01.270280 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:01.271056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:01.323397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:01.364221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-449a297c-9016-4739-ad09-bb7dced1e07f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1312 microversion: 2.1 time: 0.448398 Jun 06 14:23:01.365353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 31/55] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:00 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:01.441368 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:01.446635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:01.509331 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:01.515113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:01.532823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:01.545682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.073146 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.088973 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e598af64-1171-40a6-8eb5-b34c4546df60 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1226 microversion: 2.1 time: 0.886290 Jun 06 14:23:02.090090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 25/56] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:01 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1226 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:02.095564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:02.108082 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:02.136541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:02.145383 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.150406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.158757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-66662d33-53cb-4330-8937-7e520639c2b0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1234 microversion: 2.1 time: 0.725256 Jun 06 14:23:02.159385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 32/57] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:01 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1234 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:02.163740 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:02.165536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.211117 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:02.212906 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:02.228988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:02.241757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.245571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:02.246406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.355448 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.368648 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.373928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.379500 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-33ac0d26-70f5-4480-b451-aa8bd598cfd0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1340 microversion: 2.20 time: 0.284791 Jun 06 14:23:02.390137 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 26/58] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:02 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1340 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:02.396665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:02.397825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:02.412533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:02.413176 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.414190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:02.418102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:02.611313 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.625100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8088dc8a-6813-48ab-928e-705d354654c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1300 microversion: 2.1 time: 0.228103 Jun 06 14:23:02.626859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 27/59] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:02 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1300 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:02.735247 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:02.751484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4f1efd49-7fbe-4e3b-b262-1928ffddd5d2 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.545363 Jun 06 14:23:02.752397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 33/60] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:02 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:03.108100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:03.109172 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:03.139693 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.148297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.152140 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.155053 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.176748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:03.178229 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:03.193872 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.194614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.195646 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.197086 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.491318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:03.504175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2d982ef0-4e6c-41ff-a712-7b585152a876 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1296 microversion: 2.1 time: 0.331223 Jun 06 14:23:03.515703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 34/61] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:03 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1296 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:03.526392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:03.527822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:03.538434 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.540826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.542312 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.543321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.757669 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:03.797586 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-156d45c8-fe01-4407-bf48-1f89d3f4d9ac tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1280 microversion: 2.1 time: 0.693853 Jun 06 14:23:03.798023 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:03.808645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 28/62] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:03 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1280 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:03.817133 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:03.820200 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:03.824496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:03.827411 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:03.829076 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-18075280-ca9e-4780-8119-3b9b722046ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1340 microversion: 2.20 time: 0.309327 Jun 06 14:23:03.839251 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.839948 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.840935 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.841732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:03.843911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 35/63] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:03 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1340 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:03.953070 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-1e200462-6469-4f5a-b521-b3f5c9ac76ab req-5d807c0d-17a0-40ab-ba74-414bd415cb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002b8024-221d-4fec-bba7-9b03a34d0280", "name": "network-vif-plugged", "status": "completed", "tag": "40879521-81e3-4f32-9106-3ea8a3757175"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:03.994454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-1e200462-6469-4f5a-b521-b3f5c9ac76ab req-5d807c0d-17a0-40ab-ba74-414bd415cb2f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:03.995668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-1e200462-6469-4f5a-b521-b3f5c9ac76ab req-5d807c0d-17a0-40ab-ba74-414bd415cb2f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.030310 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-1e200462-6469-4f5a-b521-b3f5c9ac76ab req-5d807c0d-17a0-40ab-ba74-414bd415cb2f service nova] Creating event network-vif-plugged:40879521-81e3-4f32-9106-3ea8a3757175 for instance 002b8024-221d-4fec-bba7-9b03a34d0280 on hv-cinder-84414 Jun 06 14:23:04.038779 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-1e200462-6469-4f5a-b521-b3f5c9ac76ab req-5d807c0d-17a0-40ab-ba74-414bd415cb2f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193120 Jun 06 14:23:04.041146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 36/64] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:04.051969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:04.053944 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:04.073658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.073658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.074654 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.075226 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.280873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:04.311748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-052b88e3-2d44-4a05-848e-e09c1cbbbb32 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.501967 Jun 06 14:23:04.323217 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 29/65] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:03 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:04.459874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:04.476454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d52ce27e-4adf-46b2-9ed8-224fbf9e2fa9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.431925 Jun 06 14:23:04.477600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 37/66] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:04 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:04.528638 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:04.528873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:04.546470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.548001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.550758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.555095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.679064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:04.689268 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-873a33d3-2b96-4cc0-af22-25bf2c885153 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1296 microversion: 2.1 time: 0.166603 Jun 06 14:23:04.700590 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 30/67] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:04 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1296 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:04.823838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:04.825218 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:04.835349 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.835947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.837881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.838567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.908001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-d62aecd6-ea52-492d-93a0-b99759159258 req-783ace6a-3ece-4a3d-b505-964366589d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7272e33-1832-487c-9463-50a3efc67404", "tag": "f5eef75b-900b-4277-ba84-469c7ff477cd"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:04.918145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d62aecd6-ea52-492d-93a0-b99759159258 req-783ace6a-3ece-4a3d-b505-964366589d55 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.918969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d62aecd6-ea52-492d-93a0-b99759159258 req-783ace6a-3ece-4a3d-b505-964366589d55 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.940734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-d62aecd6-ea52-492d-93a0-b99759159258 req-783ace6a-3ece-4a3d-b505-964366589d55 service nova] Creating event network-changed:f5eef75b-900b-4277-ba84-469c7ff477cd for instance b7272e33-1832-487c-9463-50a3efc67404 on hv-cinder-84414 Jun 06 14:23:04.947502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-d62aecd6-ea52-492d-93a0-b99759159258 req-783ace6a-3ece-4a3d-b505-964366589d55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159506 Jun 06 14:23:04.948723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 38/68] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:04.954416 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:04.955405 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:04.962803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.963517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:04.964542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:04.965174 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.204199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:05.208657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:05.223021 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-721b0dcf-02cc-4fae-922c-f3805462d151 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.406430 Jun 06 14:23:05.233745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 31/69] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:04 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:05.268113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:05.281863 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:05.284769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:05.286951 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9a797fc0-54a2-460b-82d5-28751b4a20ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1340 microversion: 2.20 time: 0.336619 Jun 06 14:23:05.288062 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 39/70] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:04 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1340 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:05.334264 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:05.335429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:05.349611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:05.350416 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.352579 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:05.353330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.498744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:05.499842 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:05.527211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:05.527211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.528030 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:05.528835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.735978 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:05.757836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-588e0825-84c5-4fc3-8317-5e9100b9d90f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.431493 Jun 06 14:23:05.760166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 32/71] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:05 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:05.767228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:05.768223 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:05.777472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:05.778371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.779896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:05.780810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:05.943379 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:05.959820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b6f19629-e8c9-4fb1-873e-a50d54c53461 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.467878 Jun 06 14:23:05.960923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 40/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:05 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:06.089734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:06.118866 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-75d4ddbc-ddea-4648-9100-64271b31f400 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.356131 Jun 06 14:23:06.120449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 33/73] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:05 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:06.244441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:06.245063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:06.252014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:06.252493 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:06.253362 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:06.253791 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:06.258967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:06.307206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:06.308558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:06.319954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:06.320509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:06.322344 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:06.322996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:06.887844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:06.903265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3aa13313-4675-4368-9264-eb29e11126c1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.662821 Jun 06 14:23:06.917137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 41/74] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:06 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:06.927843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:06.929986 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:06.942777 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:06.943627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:06.945341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:06.947813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:07.203565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:07.220514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:07.227254 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:07.229105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-31096522-b2b8-4157-8c97-7f47c6556048 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.926953 Jun 06 14:23:07.229520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 34/75] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:06 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:07.234577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:07.235168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:07.263049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:07.265236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:07.267706 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:07.268789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:07.597189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:07.615726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1ef00ded-cbeb-4ee2-a083-57096f56ad91 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.707821 Jun 06 14:23:07.617645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 42/76] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:06 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:07.628151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:07.629090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:07.637389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:07.638010 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:07.639323 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:07.639851 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:07.781602 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:08.234041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:08.266736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e8ad0473-023c-4cd9-b2bb-4543bcd3adac tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 1.032309 Jun 06 14:23:08.279495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 35/77] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:07 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:08.287433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:08.301536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:08.329433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:08.339095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:08.344150 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:08.347789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:09.004808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=14 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:09.187621 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:09.198053 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9cdda147-4845-4f70-8de5-7a2c17bfb255 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.916888 Jun 06 14:23:09.198990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 36/78] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:08 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:09.214899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:09.215848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:09.226441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:09.227778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:09.229461 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:09.230845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:09.325889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:09.350238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e1b1e88d-f47f-4aeb-b33e-eda8f764e3be tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 1.726985 Jun 06 14:23:09.350952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 43/79] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:07 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:09.382213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:09.384162 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:09.419012 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:09.420135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:09.421878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:09.422793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:09.675959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=8 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:10.116088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=20 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:10.294967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:10.307563 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:10.310048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:10.311890 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7c0d1bfb-5167-48c8-9ba8-e6790000512d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 1.101689 Jun 06 14:23:10.313190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 37/80] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:09 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:10.333095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ef88e3c3-e40c-45a2-a909-5acf4ec10b6c req-ae1cac9f-a35f-44c8-ae5f-1c745618d537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:10.351453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ef88e3c3-e40c-45a2-a909-5acf4ec10b6c req-ae1cac9f-a35f-44c8-ae5f-1c745618d537 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.352936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ef88e3c3-e40c-45a2-a909-5acf4ec10b6c req-ae1cac9f-a35f-44c8-ae5f-1c745618d537 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:10.418491 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ef88e3c3-e40c-45a2-a909-5acf4ec10b6c req-ae1cac9f-a35f-44c8-ae5f-1c745618d537 service nova] Creating event network-changed:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:23:10.419164 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ef88e3c3-e40c-45a2-a909-5acf4ec10b6c req-ae1cac9f-a35f-44c8-ae5f-1c745618d537 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 14:23:10.422113 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.431928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:10.433263 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.433906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:10.448034 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.compute.rpcapi [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 14:23:10.449293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] Releasing lock "compute-rpcapi-router" {{(pid=117604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 14:23:10.489856 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-45316140-f018-4aa3-b2bd-dc29168bcf05 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161605 Jun 06 14:23:10.490832 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 38/81] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:10.497040 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:10.500120 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:10.521105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.521553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:10.523637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.525650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:10.550871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:10.562639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7ef33851-94a2-4356-ac32-e3658a4281f4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 1.210319 Jun 06 14:23:10.576100 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 44/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:09 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:10.581461 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:10.582279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:10.590684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.591535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:10.593179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:10.594416 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.166714 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:11.185205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:11.191204 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1cee481d-f96c-44d2-8239-befc3315736e tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.698911 Jun 06 14:23:11.194449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 39/83] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:10 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:11.209156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b530d434-18cf-40a8-a20a-30461ddef428 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.631367 Jun 06 14:23:11.211056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 45/84] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:10 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:11.224275 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:11.224910 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:11.236145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-2033fa7f-33c3-4bcf-89c1-7142fd791a21 req-bccfa66d-658a-40f5-92bb-8a95d107ad44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01d925b-d495-41e1-8810-5c4a905137f7", "tag": "d717f707-59c5-428c-99f9-a11fbd69fc24"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:11.244747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.245208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.246141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.246584 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.255969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2033fa7f-33c3-4bcf-89c1-7142fd791a21 req-bccfa66d-658a-40f5-92bb-8a95d107ad44 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.256474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2033fa7f-33c3-4bcf-89c1-7142fd791a21 req-bccfa66d-658a-40f5-92bb-8a95d107ad44 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.296144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-2033fa7f-33c3-4bcf-89c1-7142fd791a21 req-bccfa66d-658a-40f5-92bb-8a95d107ad44 service nova] Creating event network-changed:d717f707-59c5-428c-99f9-a11fbd69fc24 for instance a01d925b-d495-41e1-8810-5c4a905137f7 on hv-cinder-84414 Jun 06 14:23:11.307752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-2033fa7f-33c3-4bcf-89c1-7142fd791a21 req-bccfa66d-658a-40f5-92bb-8a95d107ad44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090452 Jun 06 14:23:11.320518 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 46/85] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:11.359956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:11.360892 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:11.382006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.382514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.383841 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.384319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.869018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:11.876668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:11.889019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e17aa123-90cb-4538-ad17-6420b64fd527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.692902 Jun 06 14:23:11.890816 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 40/86] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:11 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:11.894265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:11.896368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:11.897067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:11.898840 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:11.901571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2804388f-da8d-4016-81f0-706571b445dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.568877 Jun 06 14:23:11.903278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 47/87] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:11 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:11.906085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.906605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:11.907473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:11.907979 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.098734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:12.109369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7196c1fe-85d7-4b9b-b1e9-d6f065a654a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.217224 Jun 06 14:23:12.110013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 41/88] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:11 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:12.230324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:12.232155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:12.232780 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:12.233778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:12.240357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:12.241288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.242048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.243786 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.243984 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.244572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.245061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.246603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.247527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.616009 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:12.631928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f565b7ee-80fa-4174-b272-c86ba060e82b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.406805 Jun 06 14:23:12.632694 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 42/89] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:12 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:12.639477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-485016ed-cbc0-4c21-9d5c-96f3a802aeda req-e482c009-a00a-4970-9372-feef42aeab23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9070a8fe-f081-4116-9cf2-81094e156184", "tag": "e7fe91d4-1dec-4926-a1d7-5016c675e5d8"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:12.699573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-485016ed-cbc0-4c21-9d5c-96f3a802aeda req-e482c009-a00a-4970-9372-feef42aeab23 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.700576 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-485016ed-cbc0-4c21-9d5c-96f3a802aeda req-e482c009-a00a-4970-9372-feef42aeab23 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.732274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-485016ed-cbc0-4c21-9d5c-96f3a802aeda req-e482c009-a00a-4970-9372-feef42aeab23 service nova] Creating event network-changed:e7fe91d4-1dec-4926-a1d7-5016c675e5d8 for instance 9070a8fe-f081-4116-9cf2-81094e156184 on hv-cinder-84414 Jun 06 14:23:12.748008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-485016ed-cbc0-4c21-9d5c-96f3a802aeda req-e482c009-a00a-4970-9372-feef42aeab23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112347 Jun 06 14:23:12.753188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 43/90] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:12.786131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:12.802496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3ccfa059-f6b7-4d32-97ae-3e0804d9049d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1315 microversion: 2.1 time: 0.580977 Jun 06 14:23:12.803680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 48/91] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:12 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:12.928044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:12.929402 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:12.936208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:12.937255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:12.941044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.941847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.943310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.944181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.944558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.945039 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:12.946936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:12.947518 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.219440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:13.223225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:13.238538 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ab37e08c-c3d4-44a7-b8ab-e2fea9c504fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.314005 Jun 06 14:23:13.239823 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 44/92] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:12 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:13.246623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:13.247395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:13.248368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:13.251707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:13.255556 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d6d16f00-f4b4-4db2-a0e7-79c3e8fb8fa9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.324297 Jun 06 14:23:13.255852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.256161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.257328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 49/93] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:12 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:13.266521 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.267203 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.356796 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-5d64ef10-c616-4a34-8740-260b7fdc4ae2 req-a1f82c01-d062-4f73-9f65-718990701dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edfd401-1a2a-4b25-84da-aa19d6f4c5d3", "tag": "e9b28d33-7c58-4053-8fa5-16a9e6aa2aef"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:13.366923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-5d64ef10-c616-4a34-8740-260b7fdc4ae2 req-a1f82c01-d062-4f73-9f65-718990701dde service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.368318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-5d64ef10-c616-4a34-8740-260b7fdc4ae2 req-a1f82c01-d062-4f73-9f65-718990701dde service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.381295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-5d64ef10-c616-4a34-8740-260b7fdc4ae2 req-a1f82c01-d062-4f73-9f65-718990701dde service nova] Creating event network-changed:e9b28d33-7c58-4053-8fa5-16a9e6aa2aef for instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 on hv-cinder-84414 Jun 06 14:23:13.387727 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-5d64ef10-c616-4a34-8740-260b7fdc4ae2 req-a1f82c01-d062-4f73-9f65-718990701dde service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035111 Jun 06 14:23:13.388376 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 50/94] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:23:13.661506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:13.663203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:13.673925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.674866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.676413 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.677604 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.728177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:13.758790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3426fd54-135e-4a22-b415-d9967ac24c6a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.505959 Jun 06 14:23:13.779337 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 45/95] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:13 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:13.830174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:13.831543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:13.836008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:13.848276 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.849342 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:13.851032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:13.852629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:14.044022 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:14.056839 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a5a3c3e-280d-432b-b85c-844bb5e578e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.405511 Jun 06 14:23:14.059244 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 51/96] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:13 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:14.211892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:14.226478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8a85d289-d930-44fd-8c0f-8ee07d633a47 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1502 microversion: 2.1 time: 0.406302 Jun 06 14:23:14.228202 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 46/97] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:13 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:14.270304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:14.272935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:14.290256 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:14.291228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:14.292568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:14.293371 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:14.295862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:14.298759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:14.319103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:14.320427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:14.322659 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:14.323726 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:14.623311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:14.640060 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:14.642557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:14.644227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9a6f233b-34c2-48ce-bedb-5d6449beff70 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.362210 Jun 06 14:23:14.645120 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 47/98] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:14 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:14.649769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:14.674332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d409bcad-020d-451e-8387-589763ca5571 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.412249 Jun 06 14:23:14.676472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 52/99] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:14 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:14.788446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:14.789112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:14.796903 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:14.797347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:14.798224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:14.798653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.004910 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:15.026994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-36400272-e170-465e-9500-4216ad08f154 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.244280 Jun 06 14:23:15.028011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 48/100] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:14 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:15.089295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:15.090228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:15.096970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:15.097600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.098824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:15.099383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.366378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:15.375781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-24c22f73-f1ff-4426-81cc-160bff7751d7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.290815 Jun 06 14:23:15.376409 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 53/101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:15 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:15.673470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:15.674624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:15.690139 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:15.691017 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.692667 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:15.693469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.703164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:15.704388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:15.716614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:15.717311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.717840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:15.719445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:15.720430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:15.966064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:15.984089 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:15.988744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:15.990998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bf44ae63-f3ab-446e-b3d4-82069289c53f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.327517 Jun 06 14:23:15.992155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 49/102] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:15 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:16.016547 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:16.024869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f5bce72d-2925-4aaa-924b-bcc21a1a2802 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.330517 Jun 06 14:23:16.025937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 54/103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:15 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:16.058458 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:16.060241 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:16.069267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:16.069810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:16.072141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:16.073219 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:16.402104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:16.404022 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:16.417763 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:16.418866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:16.420553 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:16.421428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:16.574279 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:16.590760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0693e17c-cca1-4e4f-8173-25a62a01c2ca tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.548265 Jun 06 14:23:16.592407 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 50/104] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:16 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:16.768107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:16.789597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c4b0ba25-6b98-4972-91c3-8c52ba6aabfe tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.395874 Jun 06 14:23:16.789875 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 55/105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:16 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:16.940920 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90f2084a-ae9b-4780-9e4b-7605ae736b66"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:16.942944 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:16.952298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:16.952723 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:16.953730 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:16.954182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:17.025164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:17.026052 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:17.073098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:17.074043 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:17.075879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:17.077077 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:17.708336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:17.725267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:17.729038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:17.731913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-91aa4cad-70fd-4da1-8fe0-8aae5c4a149f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.720774 Jun 06 14:23:17.733581 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 56/106] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:17 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:17.744712 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-3a203b80-ce81-4864-8d4c-903f3427319a req-6aa6f340-ed80-47e5-8d7a-9836a6a6d52a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9070a8fe-f081-4116-9cf2-81094e156184", "name": "network-vif-plugged", "status": "completed", "tag": "e7fe91d4-1dec-4926-a1d7-5016c675e5d8"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:17.762704 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-3a203b80-ce81-4864-8d4c-903f3427319a req-6aa6f340-ed80-47e5-8d7a-9836a6a6d52a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:17.763508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-3a203b80-ce81-4864-8d4c-903f3427319a req-6aa6f340-ed80-47e5-8d7a-9836a6a6d52a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:17.783055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-3a203b80-ce81-4864-8d4c-903f3427319a req-6aa6f340-ed80-47e5-8d7a-9836a6a6d52a service nova] Creating event network-vif-plugged:e7fe91d4-1dec-4926-a1d7-5016c675e5d8 for instance 9070a8fe-f081-4116-9cf2-81094e156184 on hv-cinder-84414 Jun 06 14:23:17.790248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-3a203b80-ce81-4864-8d4c-903f3427319a req-6aa6f340-ed80-47e5-8d7a-9836a6a6d52a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054698 Jun 06 14:23:17.790873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 57/107] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:17.799631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:17.800407 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:17.810209 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:17.810743 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:17.811609 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:17.812139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.000132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:18.016241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-db6a98e2-9928-4061-9d35-b831c57972a6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.220543 Jun 06 14:23:18.026255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 58/108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:17 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:18.030575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:18.031201 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:18.037651 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:18.038152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.038959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:18.040185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.211543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:18.215947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:18.222229 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d7f00f94-ae9e-4766-bdbc-bb606ceac9c6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.203465 Jun 06 14:23:18.222905 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 59/109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:18 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:18.229421 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:18.230332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:18.237462 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:18.238107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.239061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:18.239560 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.397308 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:18.406287 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b5ba669d-4078-459f-b765-b74a821e555d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.182089 Jun 06 14:23:18.406883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 60/110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:18 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:18.768646 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:18.772056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:18.780660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:18.781262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.782219 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:18.782914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:18.993328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:19.004178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:19.008630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:19.010462 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1a3df24c-1d29-4386-a6cd-19704cf2cbbb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.249794 Jun 06 14:23:19.011335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 61/111] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:18 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:19.035085 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:19.035791 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:19.043694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:19.044295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:19.045098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:19.045579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:19.267347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:19.279638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-34c09640-5c3c-41d1-83d9-3624d674f32b tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.248478 Jun 06 14:23:19.280450 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 62/112] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:19 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:19.289208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:19.290891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:19.300997 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:19.301534 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:19.302864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:19.303442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:19.500205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:19.514579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ebe6ee82-d6d4-49bf-9888-8d9beb80efd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.232301 Jun 06 14:23:19.515597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 63/113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:19 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:19.521831 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:19.522698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:19.533745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:19.534388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:19.535529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:19.536211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:19.715538 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:19.724719 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8982023c-829c-4079-8864-f6a10fea0c00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.207620 Jun 06 14:23:19.725684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 64/114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:19 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:20.031344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:20.032246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:20.040569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.041406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.042320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.042791 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.203357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:20.212269 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:20.215300 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:20.216501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-868af065-84fc-4cad-b621-c42bf37550fa tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.189385 Jun 06 14:23:20.217100 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 65/115] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:20 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:20.305738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:20.306299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:20.313194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.313661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.314522 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.315029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.446689 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:20.464039 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:20.472305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e43d565f-50d4-4d80-bbe4-b18cb3b40b0e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.171300 Jun 06 14:23:20.472892 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 66/116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:20 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:20.540498 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:20.541136 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:20.548341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.548959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.549896 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.550399 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.710138 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:20.723322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d61a4e59-3e98-456f-ae29-682021b18dc0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.186964 Jun 06 14:23:20.724202 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 67/117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:20 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:20.749381 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:20.750325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:20.757686 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.758384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.759427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:20.760056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:20.925485 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:20.939710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-069188d6-f4b7-4fe1-a681-e5988efcaff0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.194335 Jun 06 14:23:20.940995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 68/118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:20 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:21.240664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:21.242185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:21.261248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.262051 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.264261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.266380 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.645463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5f76aadb-53ed-4a6a-8c29-42ef584e7fb4 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "POST /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.709390 Jun 06 14:23:21.646639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 51/119] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:23:16 2022] POST /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280/os-volume_attachments => generated 194 bytes in 4712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:21.661144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:21.662803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:21.687168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.689498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.692352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.692967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:21.693198 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.710805 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:21.712864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:21.715622 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7fd652bc-747c-4832-99c5-d2be772e03ab tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.478000 Jun 06 14:23:21.719823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 69/120] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:21 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:21.743338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:21.743749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:21.753263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.754277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.755567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.756222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.941031 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:21.950700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-70e28e59-8bca-4485-9f8b-825f8bb4acec tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.302484 Jun 06 14:23:21.951317 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 52/121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:21 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:21.965954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:21.966815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:21.970139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:21.974301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.974963 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.977003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:21.977767 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:21.980528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cca76b54-996b-464c-9cab-9752fb2b0b34 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.242293 Jun 06 14:23:21.981118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 70/122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:21 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:22.138427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:22.149050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d5a5c1a9-dd89-4158-98fc-6d4b6876e423 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.188005 Jun 06 14:23:22.149956 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 53/123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:21 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:22.738358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:22.738949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:22.749819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:22.750652 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:22.752150 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:22.752981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:22.934338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:22.943610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:22.945889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:22.947484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-05fddbe3-f2c3-495d-b365-738380412f4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.213346 Jun 06 14:23:22.948123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 71/124] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:22 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:22.969334 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:22.970086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:22.978351 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:22.978796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:22.979870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:22.980352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:23.001730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:23.002885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:23.011142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:23.011587 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:23.012414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:23.012847 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:23.216422 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:23.227350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2c7d9039-b4b1-4bfe-98d6-4134ee9be151 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.261897 Jun 06 14:23:23.228137 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 54/125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:22 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:23.237185 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:23.238220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:23.239019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:23.252301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ccfd9982-9069-436b-8253-3315c1211026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.255074 Jun 06 14:23:23.253421 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 72/126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:22 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:23.255965 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:23.256875 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:23.259106 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:23.259896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:23.447455 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:23.456261 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5699eb3b-3e81-41c5-a445-6e71a3277259 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.226849 Jun 06 14:23:23.457081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 55/127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:23 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:23.969292 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:23.969971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:23.977377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:23.977875 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:23.978795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:23.979248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.137405 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:24.146022 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:24.147725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:24.150027 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9f395399-e739-4b51-8dc0-6d695ae95314 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.184669 Jun 06 14:23:24.150614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 73/128] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:23 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:24.252019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:24.252769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:24.260975 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:24.261429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.262256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:24.262689 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.279223 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:24.280060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:24.287582 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:24.288669 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.290575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:24.291028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.565783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:24.576769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:24.581164 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6e702d3a-e4f8-4ea5-9efd-3aeae81041c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.332834 Jun 06 14:23:24.582290 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 56/129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:24 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:24.589024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:24.590002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:24.591043 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-23ef3547-2f6d-4d96-818c-615594873497 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.315260 Jun 06 14:23:24.592378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 74/130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:24 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:24.601041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:24.602692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.603143 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:24.603728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:24.780233 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:24.790456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a67ab2c7-974a-4011-9dfe-f7036041876c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.205843 Jun 06 14:23:24.791515 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 57/131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:24 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:25.181386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:25.186954 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:25.207801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:25.209341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:25.231041 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:25.231762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:25.578128 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:25.593344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:25.596733 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:25.598963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b9996a9a-bb3e-4393-a5f0-4e126058d396 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.431362 Jun 06 14:23:25.600090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 75/132] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:25 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:25.607476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:25.608134 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:25.615959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:25.616236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:25.616848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:25.617272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:25.618368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:25.618920 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:25.627114 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:25.627724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:25.628610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:25.629091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:25.671806 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:26.004135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:26.018323 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-02db012e-059b-41ea-bc06-618b484adf25 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.410535 Jun 06 14:23:26.019392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 76/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:25 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:26.058846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:26.060080 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:26.083005 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:26.084170 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:26.086377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:26.087813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:26.533470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:26.582906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5dbbe6d1-e50c-4c78-bbaa-6b65a7ab896d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1363 microversion: 2.1 time: 0.976648 Jun 06 14:23:26.582906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 58/134] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:25 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1363 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:26.591858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-702198aa-f05a-492d-a34e-db9d1ed70f6d req-11b2492f-a8a1-4e34-9250-6780f1734295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "name": "network-vif-plugged", "status": "completed", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:26.652385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-702198aa-f05a-492d-a34e-db9d1ed70f6d req-11b2492f-a8a1-4e34-9250-6780f1734295 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:26.653518 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-702198aa-f05a-492d-a34e-db9d1ed70f6d req-11b2492f-a8a1-4e34-9250-6780f1734295 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:26.743133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:26.745855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-702198aa-f05a-492d-a34e-db9d1ed70f6d req-11b2492f-a8a1-4e34-9250-6780f1734295 service nova] Creating event network-vif-plugged:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:23:26.761238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5a626e5a-6e51-4d84-b93d-0160511c1773 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.723259 Jun 06 14:23:26.772684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-702198aa-f05a-492d-a34e-db9d1ed70f6d req-11b2492f-a8a1-4e34-9250-6780f1734295 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187769 Jun 06 14:23:26.774163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 59/135] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:26.778419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 77/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:26 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:26.802812 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:26.803816 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:26.831542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:26.832004 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:26.832831 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:26.833301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:27.054858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:27.059364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:27.078997 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:27.080051 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:27.081585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:27.082486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:27.100672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:27.111148 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:27.113160 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:27.114903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d284492-1349-422e-afcf-bf5501ac4d5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.325688 Jun 06 14:23:27.123380 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 78/137] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:26 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:27.341365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:27.358737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-348c8354-bcfe-452d-952d-0c0c08f661af tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.315632 Jun 06 14:23:27.395655 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 60/138] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:27 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:27.599766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:27.600755 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:27.612846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:27.613313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:27.614179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:27.614626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:27.798009 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:27.799335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:27.814430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:27.822536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:27.823721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:27.824387 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:28.448009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:28.459215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6ee9fefd-34e5-4b12-a69e-39ac3b3a6080 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1550 microversion: 2.1 time: 0.863557 Jun 06 14:23:28.477971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 79/139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:27 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1550 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:28.483211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:28.489913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:28.513766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:28.515913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:28.523179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:28.523980 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:28.585998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:28.599786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f2343455-6571-468d-b51f-f88785a9c8d9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.807299 Jun 06 14:23:28.613986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 61/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:27 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:28.631015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:28.631957 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:28.641788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:28.642543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:28.643998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:28.644810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:28.956334 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:28.970848 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:28.971138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:28.975522 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:28.977922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-64b25e84-3c6b-4694-bfe9-754b058288bb tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1408 microversion: 2.20 time: 0.498882 Jun 06 14:23:28.979511 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 80/141] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:28 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:23:28.990442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:28.991611 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:28.996871 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d4639fe0-d4f2-41d2-a4dd-0e42ae1f9403 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.378550 Jun 06 14:23:28.998049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 62/142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:28 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:29.004285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:29.005030 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:29.006334 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:29.007286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:29.009055 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ecaf9e37-a505-4d84-9995-4776e68505cd req-b9fa25aa-de56-4482-b9d6-78edd64ba558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7272e33-1832-487c-9463-50a3efc67404", "name": "network-vif-plugged", "status": "completed", "tag": "f5eef75b-900b-4277-ba84-469c7ff477cd"}, {"server_uuid": "a01d925b-d495-41e1-8810-5c4a905137f7", "name": "network-vif-plugged", "status": "completed", "tag": "d717f707-59c5-428c-99f9-a11fbd69fc24"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:29.028742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ecaf9e37-a505-4d84-9995-4776e68505cd req-b9fa25aa-de56-4482-b9d6-78edd64ba558 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:29.029601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ecaf9e37-a505-4d84-9995-4776e68505cd req-b9fa25aa-de56-4482-b9d6-78edd64ba558 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:29.061306 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ecaf9e37-a505-4d84-9995-4776e68505cd req-b9fa25aa-de56-4482-b9d6-78edd64ba558 service nova] Creating event network-vif-plugged:f5eef75b-900b-4277-ba84-469c7ff477cd for instance b7272e33-1832-487c-9463-50a3efc67404 on hv-cinder-84414 Jun 06 14:23:29.061742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ecaf9e37-a505-4d84-9995-4776e68505cd req-b9fa25aa-de56-4482-b9d6-78edd64ba558 service nova] Creating event network-vif-plugged:d717f707-59c5-428c-99f9-a11fbd69fc24 for instance a01d925b-d495-41e1-8810-5c4a905137f7 on hv-cinder-84414 Jun 06 14:23:29.073307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-ecaf9e37-a505-4d84-9995-4776e68505cd req-b9fa25aa-de56-4482-b9d6-78edd64ba558 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072339 Jun 06 14:23:29.074360 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 63/143] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:29.274506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-63d6ff3e-3a18-4cb1-b546-2fce1e451914 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.289110 Jun 06 14:23:29.275195 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 81/144] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:23:28 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-interface => generated 285 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:29.629127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:29.631858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:29.655301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:29.657319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:29.658257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:29.660794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:29.997487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:29.998824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:30.016782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:30.018290 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:30.023933 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:30.025237 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:30.265415 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:30.290001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3892c3bb-d0a1-4374-83a4-60eb90a751f8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.669342 Jun 06 14:23:30.290976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 64/145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:29 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:30.306556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:30.310041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:30.326041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:30.326884 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:30.327768 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:30.328211 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:30.745793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:30.764557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:30.767714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:30.770077 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-88fc5191-c602-49ab-ab6e-5f78542aa342 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1599 microversion: 2.20 time: 0.777000 Jun 06 14:23:30.771293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 82/146] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:23:29 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1599 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:23:30.830114 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:30.831276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:30.839707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:30.840502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:30.842212 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:30.842836 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:31.073373 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:31.098356 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9adf626b-3cae-4337-8dbb-6c4ab546e4de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.796317 Jun 06 14:23:31.100650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 65/147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:30 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:31.111146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-78dfb959-fb24-4c2d-ab86-3da788bccfa2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.301306 Jun 06 14:23:31.111953 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 83/148] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jun 6 14:23:30 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 14:23:31.133354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-b35877e1-fb5a-4513-97cc-fb0826ae51a0 req-9d4af153-0030-4bb2-9abc-52f63889b47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edfd401-1a2a-4b25-84da-aa19d6f4c5d3", "name": "network-vif-plugged", "status": "completed", "tag": "e9b28d33-7c58-4053-8fa5-16a9e6aa2aef"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:31.147121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-b35877e1-fb5a-4513-97cc-fb0826ae51a0 req-9d4af153-0030-4bb2-9abc-52f63889b47c service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:31.147859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-b35877e1-fb5a-4513-97cc-fb0826ae51a0 req-9d4af153-0030-4bb2-9abc-52f63889b47c service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:31.183773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:31.191227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-b35877e1-fb5a-4513-97cc-fb0826ae51a0 req-9d4af153-0030-4bb2-9abc-52f63889b47c service nova] Creating event network-vif-plugged:e9b28d33-7c58-4053-8fa5-16a9e6aa2aef for instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 on hv-cinder-84414 Jun 06 14:23:31.204600 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-b35877e1-fb5a-4513-97cc-fb0826ae51a0 req-9d4af153-0030-4bb2-9abc-52f63889b47c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087925 Jun 06 14:23:31.205280 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 66/149] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:31.309620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:31.310519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:31.318377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:31.319532 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:31.322688 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:31.324818 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:31.698631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:31.706976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8b761657-d449-46db-9c48-936e4ca9c2f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.401296 Jun 06 14:23:31.711815 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 84/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:31 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:32.134433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:32.140080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:32.165886 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:32.173187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:32.176286 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:32.177125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:32.234879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-2a212de7-9a80-4585-aa02-c485ab1769a7 req-1e2742b3-19b2-4112-81e6-376775fb3399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9070a8fe-f081-4116-9cf2-81094e156184", "tag": "e7fe91d4-1dec-4926-a1d7-5016c675e5d8"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:32.287492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2a212de7-9a80-4585-aa02-c485ab1769a7 req-1e2742b3-19b2-4112-81e6-376775fb3399 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:32.289046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2a212de7-9a80-4585-aa02-c485ab1769a7 req-1e2742b3-19b2-4112-81e6-376775fb3399 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:32.341462 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-2a212de7-9a80-4585-aa02-c485ab1769a7 req-1e2742b3-19b2-4112-81e6-376775fb3399 service nova] Creating event network-changed:e7fe91d4-1dec-4926-a1d7-5016c675e5d8 for instance 9070a8fe-f081-4116-9cf2-81094e156184 on hv-cinder-84414 Jun 06 14:23:32.358048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-2a212de7-9a80-4585-aa02-c485ab1769a7 req-1e2742b3-19b2-4112-81e6-376775fb3399 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129946 Jun 06 14:23:32.359506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 85/151] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:32.623267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:32.642633 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2f6fb1df-6a41-405a-b47d-7744c57da4cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.517776 Jun 06 14:23:32.643668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 67/152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:32 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:32.744195 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:32.745827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:32.757427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:32.759603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:32.767113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:32.767821 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:33.272372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:33.297002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-03e0be3a-3811-4b6e-9924-9a34bece9b9f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.556947 Jun 06 14:23:33.297968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 86/153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:32 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:33.479438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-b1e07a59-661b-44a5-8720-f4a4661c8d18 req-80d200b1-39e2-42d5-a9a3-df518544ac06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:33.520185 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-b1e07a59-661b-44a5-8720-f4a4661c8d18 req-80d200b1-39e2-42d5-a9a3-df518544ac06 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:33.520684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-b1e07a59-661b-44a5-8720-f4a4661c8d18 req-80d200b1-39e2-42d5-a9a3-df518544ac06 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:33.549553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-b1e07a59-661b-44a5-8720-f4a4661c8d18 req-80d200b1-39e2-42d5-a9a3-df518544ac06 service nova] Creating event network-changed:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:23:33.558189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-b1e07a59-661b-44a5-8720-f4a4661c8d18 req-80d200b1-39e2-42d5-a9a3-df518544ac06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087819 Jun 06 14:23:33.559489 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 68/154] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:33.708971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:33.710268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:33.732993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:33.737955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:33.739257 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:33.741025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:34.093140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:34.103104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3aa07464-940c-4c36-88ce-3d29f909e71d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.436024 Jun 06 14:23:34.104461 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 87/155] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:33 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:34.335934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:34.340707 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:34.374373 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:34.378336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:34.386087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:34.389336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:34.728833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:34.739285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-59d498ee-52a7-4259-b87a-48bf6edb05b6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.412985 Jun 06 14:23:34.740525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 69/156] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:34 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:35.132955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:35.138781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:35.160383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:35.163317 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:35.172174 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:35.173100 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:35.495649 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:35.530213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-709f4417-e77c-4699-bd33-bf72b4fd5a59 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1367 microversion: 2.1 time: 0.405401 Jun 06 14:23:35.531630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 88/157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:35 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:35.780467 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:35.782484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:35.800064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:35.802077 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:35.803657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:35.804967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:36.034541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:36.050504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9bd06c2f-b12e-4a62-aff5-471d4283c34d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.291968 Jun 06 14:23:36.053050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 70/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:35 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:36.556503 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:36.557747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:36.565577 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:36.566292 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:36.567169 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:36.567783 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:36.743156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:36.755363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7c735733-92de-4531-b1e8-99bb0dc85570 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1558 microversion: 2.1 time: 0.209264 Jun 06 14:23:36.756554 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 89/159] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:36 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:36.777666 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:36.778192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:36.785807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:36.786577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:36.787293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:36.787737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:37.007693 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-28d90f40-0d9e-448b-a162-65e2a0ef2324 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233617 Jun 06 14:23:37.011091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 71/160] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:23:36 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:37.072246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:37.073085 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:37.094188 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:37.094188 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:37.094188 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:37.094705 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:37.770501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:37.794367 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ec658e49-ea88-4346-b662-228031eb9a9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.726166 Jun 06 14:23:37.798348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 90/161] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:37 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:37.876732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:37.877663 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:37.904354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:37.905211 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:37.906919 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:37.907725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:37.963217 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:23:38.160456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3db1b4a7-c20e-4819-98f7-6d28ed97ada3 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 204 len: 0 microversion: 2.1 time: 0.292788 Jun 06 14:23:38.163027 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 72/162] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:23:37 2022] DELETE /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:23:38.171957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:38.172628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:38.179980 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:38.180426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:38.181528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:38.182171 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:38.453368 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:38.472023 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-71c27305-0a9c-4939-b29d-9e9fb648ed58 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1554 microversion: 2.1 time: 0.303706 Jun 06 14:23:38.473962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 91/163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:38 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:38.822583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:38.823818 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:38.844413 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:38.845094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:38.846906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:38.848783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:39.496956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:39.499441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:39.516906 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:39.517490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:39.518541 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:39.519225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:39.537363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:39.559930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3f855676-9c22-47cc-b74d-916d53fcd926 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1322 microversion: 2.1 time: 0.745205 Jun 06 14:23:39.561672 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 73/164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:38 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1322 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:39.756641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-e579e4fd-e494-42c3-a476-b8f99806cdfb req-a2ab2a6f-ee82-4e29-bde0-9af1d4869801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01d925b-d495-41e1-8810-5c4a905137f7", "tag": "d717f707-59c5-428c-99f9-a11fbd69fc24"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:39.782614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e579e4fd-e494-42c3-a476-b8f99806cdfb req-a2ab2a6f-ee82-4e29-bde0-9af1d4869801 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:39.786449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e579e4fd-e494-42c3-a476-b8f99806cdfb req-a2ab2a6f-ee82-4e29-bde0-9af1d4869801 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:39.847224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-e579e4fd-e494-42c3-a476-b8f99806cdfb req-a2ab2a6f-ee82-4e29-bde0-9af1d4869801 service nova] Creating event network-changed:d717f707-59c5-428c-99f9-a11fbd69fc24 for instance a01d925b-d495-41e1-8810-5c4a905137f7 on hv-cinder-84414 Jun 06 14:23:39.876093 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:39.887609 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-47aac495-4119-4a44-a0ab-2c4bbb3215fe tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1554 microversion: 2.1 time: 0.396944 Jun 06 14:23:39.889439 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 92/165] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:39 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1554 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:39.902922 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-e579e4fd-e494-42c3-a476-b8f99806cdfb req-a2ab2a6f-ee82-4e29-bde0-9af1d4869801 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151121 Jun 06 14:23:39.913874 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 74/166] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:40.590784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:40.591572 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:40.610208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:40.612134 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:40.614173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:40.614612 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:40.917658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:40.927365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:40.940240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:40.940689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:40.940828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:40.941487 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:40.942188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:40.952282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c3c3fb55-f0d8-44ef-a0e2-c7a6f582f651 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1516 microversion: 2.1 time: 0.366928 Jun 06 14:23:40.957616 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 93/167] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:40 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1516 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:40.993812 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:40.996509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:41.031853 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:41.037814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:41.042558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:41.045600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:41.108081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:41.115431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lazy-loading 'flavor' on Instance uuid 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:23:41.145056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:41.157200 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-65bc671d-f72c-4b3e-ad9c-f2fcff2ac53f tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1554 microversion: 2.1 time: 0.253075 Jun 06 14:23:41.158346 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 75/168] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:40 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:41.280764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d2f06973-d482-44a2-ad12-4cc4dca84215 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3/action" status: 200 len: 32 microversion: 2.1 time: 0.299496 Jun 06 14:23:41.282527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 94/169] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:23:40 2022] POST /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:23:41.296205 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:41.297362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:41.307378 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:41.310341 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:41.311648 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:41.326918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:41.626091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:41.636861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c9d4b479-1663-4299-a7aa-26b8d1d86b18 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.345657 Jun 06 14:23:41.644860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 76/170] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:41 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:42.185899 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:42.188414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:42.204179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:42.204634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:42.211214 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:42.211662 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:42.578711 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:42.594082 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-62d70465-6538-45d0-a19a-f681f47cebec tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1554 microversion: 2.1 time: 0.420546 Jun 06 14:23:42.594661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 95/171] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:42 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1554 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:42.677093 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:42.678891 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:42.692362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:42.692362 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:42.694093 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:42.694920 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:42.925271 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-bfd73865-f07f-4ae3-9427-9b7b1142406b req-dba16157-dbb0-428e-b236-d5cb847bc5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "002b8024-221d-4fec-bba7-9b03a34d0280", "name": "network-vif-deleted", "tag": "40879521-81e3-4f32-9106-3ea8a3757175"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:23:42.946670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=96 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:42.963404 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-bfd73865-f07f-4ae3-9427-9b7b1142406b req-dba16157-dbb0-428e-b236-d5cb847bc5ef service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:42.963897 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-bfd73865-f07f-4ae3-9427-9b7b1142406b req-dba16157-dbb0-428e-b236-d5cb847bc5ef service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:42.994115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-bfd73865-f07f-4ae3-9427-9b7b1142406b req-dba16157-dbb0-428e-b236-d5cb847bc5ef service nova] Creating event network-vif-deleted:40879521-81e3-4f32-9106-3ea8a3757175 for instance 002b8024-221d-4fec-bba7-9b03a34d0280 on hv-cinder-84414 Jun 06 14:23:43.004788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-bfd73865-f07f-4ae3-9427-9b7b1142406b req-dba16157-dbb0-428e-b236-d5cb847bc5ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086865 Jun 06 14:23:43.005239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:43.007739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 96/172] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:23:43.037981 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0bae94c9-3038-413d-917c-992e3650e482 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.363890 Jun 06 14:23:43.037981 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 77/173] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:42 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:43.614523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:43.615326 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:43.623061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:43.623548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:43.624449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:43.624900 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:43.664891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:43.665608 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:43.666415 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lazy-loading 'fault' on Instance uuid 002b8024-221d-4fec-bba7-9b03a34d0280 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:23:43.731003 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fee90ee6694ae4a821f60ca194ce84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ab6d13d539433a853fc6805d819b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:43.751059 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4906d2ac-a5db-4765-8802-04445291d61d tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 200 len: 1351 microversion: 2.1 time: 0.142132 Jun 06 14:23:43.752346 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 97/174] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:43 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 1351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:44.066732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:44.067574 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:44.070503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:44.082798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:44.083783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:44.086094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:44.087205 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:44.316810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:44.340202 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f79132c1-878a-4a5d-a3ba-14f6017d9203 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.278131 Jun 06 14:23:44.341006 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 78/175] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:44 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:44.782595 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:44.783796 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:44.796552 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:44.797751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:44.800264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:44.800264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] HTTP exception thrown: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Request method failure captured: Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 HTTP/1.1 Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2X0lx09u2rFFJg5HjFKsBQQC6OH_uQU5UzhEVie4vgXo4lmnISwHnESQeEqHt3trbPCGYE5F_j0fwebbVU9QwUvDPv6MH97JuoHV4mcjKWE2Ht7O84tVBo7dSVkiiDtgYbCiXJNBN8RAzarJ9ajsytQFjGxBygJZlIzZHqvNA6PBY Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:23:44.837776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2ab6d13d539433a853fc6805d819b85", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}] Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: a5fee90ee6694ae4a821f60ca194ce84 Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:44.840356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '002b8024-221d-4fec-bba7-9b03a34d0280'} Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:23:44.842586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:44.845040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:44.847104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Returning 404 to user: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:23:44.847104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-88e04099-45f2-4b99-b55d-f45ee8329ec9 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 404 len: 111 microversion: 2.1 time: 0.062067 Jun 06 14:23:44.847104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 98/176] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:44 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:23:45.003885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:45.006070 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:45.018152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:45.018896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:45.020432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:45.021395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:45.048882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] HTTP exception thrown: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Request method failure captured: Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280/os-volume_attachments HTTP/1.1 Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2X0lx09u2rFFJg5HjFKsBQQC6OH_uQU5UzhEVie4vgXo4lmnISwHnESQeEqHt3trbPCGYE5F_j0fwebbVU9QwUvDPv6MH97JuoHV4mcjKWE2Ht7O84tVBo7dSVkiiDtgYbCiXJNBN8RAzarJ9ajsytQFjGxBygJZlIzZHqvNA6PBY Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:23:45.057902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2ab6d13d539433a853fc6805d819b85", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}] Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: a5fee90ee6694ae4a821f60ca194ce84 Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:45.060566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'server_id': '002b8024-221d-4fec-bba7-9b03a34d0280'} Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:23:45.062043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:45.064050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:23:45.065977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Returning 404 to user: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:23:45.065977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8d010ff8-e3af-4036-820b-eba9fb2af520 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063307 Jun 06 14:23:45.065977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 79/177] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:23:44 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:23:45.362880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:45.364047 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:45.375457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:45.376076 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:45.381668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:45.383323 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:45.578767 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:45.591132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1fafe13b-5c63-4496-8ac6-b68e167467fd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.235300 Jun 06 14:23:45.592191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 99/178] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:45 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:46.613532 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:46.614652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:46.629531 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:46.630345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:46.631572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:46.632428 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:46.666563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:46.667916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:46.676935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:46.677752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:46.678689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:46.680325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:46.704124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] HTTP exception thrown: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Request method failure captured: Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 HTTP/1.1 Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2X0lx09u2rFFJg5HjFKsBQQC6OH_uQU5UzhEVie4vgXo4lmnISwHnESQeEqHt3trbPCGYE5F_j0fwebbVU9QwUvDPv6MH97JuoHV4mcjKWE2Ht7O84tVBo7dSVkiiDtgYbCiXJNBN8RAzarJ9ajsytQFjGxBygJZlIzZHqvNA6PBY Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:23:46.707573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2ab6d13d539433a853fc6805d819b85", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}] Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: a5fee90ee6694ae4a821f60ca194ce84 Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.710324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '002b8024-221d-4fec-bba7-9b03a34d0280'} Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:23:46.711671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.714495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.719474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Returning 404 to user: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:23:46.719474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-46577ffa-6041-4c0a-9527-c826c906c0df tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 404 len: 111 microversion: 2.1 time: 0.049875 Jun 06 14:23:46.719474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 100/179] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:23:46 2022] DELETE /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:23:46.726730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:46.727917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] [instance: 002b8024-221d-4fec-bba7-9b03a34d0280] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:46.741994 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:46.742933 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:46.745836 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:46.748026 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:46.779587 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] HTTP exception thrown: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Request method failure captured: Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 HTTP/1.1 Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2X0lx09u2rFFJg5HjFKsBQQC6OH_uQU5UzhEVie4vgXo4lmnISwHnESQeEqHt3trbPCGYE5F_j0fwebbVU9QwUvDPv6MH97JuoHV4mcjKWE2Ht7O84tVBo7dSVkiiDtgYbCiXJNBN8RAzarJ9ajsytQFjGxBygJZlIzZHqvNA6PBY Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:23:46.781680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c2ab6d13d539433a853fc6805d819b85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c2ab6d13d539433a853fc6805d819b85", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c2ab6d13d539433a853fc6805d819b85"}]}] Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: c2ab6d13d539433a853fc6805d819b85 Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-DeleteServersTestJSON-762500672 Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: a5fee90ee6694ae4a821f60ca194ce84 Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-DeleteServersTestJSON-762500672-project Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.783094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '002b8024-221d-4fec-bba7-9b03a34d0280'} Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:23:46.783965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. Jun 06 14:23:46.785025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:23:46.786046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] Returning 404 to user: Instance 002b8024-221d-4fec-bba7-9b03a34d0280 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:23:46.786046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-09901675-d966-487c-a51c-b9b553c54017 tempest-DeleteServersTestJSON-762500672 tempest-DeleteServersTestJSON-762500672-project] 10.222.0.13 "GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280" status: 404 len: 111 microversion: 2.1 time: 0.065208 Jun 06 14:23:46.787605 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 101/180] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:46 2022] GET /compute/v2.1/servers/002b8024-221d-4fec-bba7-9b03a34d0280 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:23:46.952285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:46.968448 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0fa55da6-d576-4fd9-beed-ca400bf821b4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.362494 Jun 06 14:23:46.969871 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 80/181] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:46 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:47.994379 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:47.995070 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:48.001319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:48.001802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:48.002592 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:48.003022 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:48.253385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:48.265073 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-58762338-0223-4745-b346-90ac2460b1c8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.274282 Jun 06 14:23:48.265800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 102/182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:47 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:49.284471 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:49.285937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:49.293645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:49.294114 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:49.295207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:49.295560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:49.502576 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:49.518738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-73e26bed-4584-418f-8ad7-5b919d3c5c83 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.238224 Jun 06 14:23:49.519925 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 81/183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:49 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:50.544163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:50.545409 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:50.557934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:50.558752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:50.560152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:50.560963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:50.775621 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:50.786885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-60495255-783e-420d-a42b-ce4aeb240d21 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.251304 Jun 06 14:23:50.787572 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 103/184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:50 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:51.829533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:51.830717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:51.839769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:51.840245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:51.841026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:51.841456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:52.040240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:52.050655 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-702887e4-ace6-4544-be1e-0c2a9759975e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.226500 Jun 06 14:23:52.060835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 82/185] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:51 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:53.068199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:53.068945 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:53.077270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:53.077733 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:53.078647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:53.078965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:53.291876 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:53.304627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a220a1a0-b846-46c2-b1f4-afae989a0261 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.239193 Jun 06 14:23:53.313353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 104/186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:53 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:23:54.340678 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:54.341889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:54.364898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:54.365699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:54.373068 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:54.373860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:54.625969 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:54.638314 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9dbc9d57-9512-4f90-a15e-64d1f1591cdd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.305258 Jun 06 14:23:54.638644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 83/187] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:54 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:55.656969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:55.658080 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:55.666749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:55.673282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:55.673282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:55.673282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:55.861284 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:55.871208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-98b54e2e-26ac-4703-bc02-2bf2c3449bf6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.219688 Jun 06 14:23:55.872132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 105/188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:55 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:56.894747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:56.895738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:56.911149 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:56.912199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:56.915735 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:56.917460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:56.925644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:23:57.257906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:57.276764 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d5b82b3d-4824-4dd4-86f3-c8898e9d72f6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.390333 Jun 06 14:23:57.289966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 84/189] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:56 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:58.315030 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:58.316870 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:58.329318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:58.330434 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:58.332149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:58.333083 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:58.492965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:58.500990 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7fa6152a-e9ed-4e19-80f6-396b4c4eb5e5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.194883 Jun 06 14:23:58.501574 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 106/190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:58 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:23:59.518641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:23:59.519527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:23:59.530927 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:59.531672 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:59.532932 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:23:59.533675 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:23:59.707679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:23:59.716643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-db902fd5-65ec-4e8e-99df-2a28419ae858 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.201833 Jun 06 14:23:59.717245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 85/191] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:23:59 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:00.746167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:00.747506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:00.754630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:00.755095 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:00.755911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:00.756438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:00.905375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:00.919707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-962426d4-1266-45ae-b9e8-7f46bde57f30 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.177988 Jun 06 14:24:00.920808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 107/192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:00 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:01.941477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:01.943821 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:01.955083 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:01.955525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:01.960439 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:01.961387 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:02.220413 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:02.233834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bf2916cf-20e9-438a-9ee2-7a9157f99ee3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.297590 Jun 06 14:24:02.235210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 86/193] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:01 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:03.261019 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:03.261795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:03.268517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:03.269474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:03.270352 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:03.270800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:03.563932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:03.581624 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-05f1b41e-0269-4b23-ba28-807344b556a6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.324701 Jun 06 14:24:03.582454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 108/194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:03 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:04.606191 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:04.607225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:04.621485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:04.622070 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:04.622928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:04.623438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:04.868463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:04.887189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c75fe25e-ce84-4224-88c9-1015672cea25 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.286396 Jun 06 14:24:04.888037 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 87/195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:04 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:05.914441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:05.916610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:05.933167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:05.934658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:05.936305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:05.938313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:06.183658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:06.198871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3297a4ee-92c1-4597-8d25-1b6b2994e4c0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.295493 Jun 06 14:24:06.200384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 109/196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:05 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:07.221059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:07.221966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:07.245356 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:07.246138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:07.247439 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:07.248775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:07.506354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:07.524908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-14bc4c07-e59f-474d-9bed-4ab6ddca8458 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.310225 Jun 06 14:24:07.542287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 88/197] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:07 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:08.573495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:08.577155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:08.592474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:08.593256 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:08.595945 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:08.597096 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:08.911585 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:08.928264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f7e59ead-82f5-431d-9a56-0452e6509ec1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.364594 Jun 06 14:24:08.933350 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 110/198] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:08 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:09.954337 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:09.955866 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:09.972368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:09.975251 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:09.977361 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:09.978170 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:10.200801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:10.221560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3adaadd0-f5fb-4d30-92ac-ef7ceb166d9c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.274208 Jun 06 14:24:10.222385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 89/199] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:09 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:11.253349 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:11.254771 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:11.264165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:11.265784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:11.266435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:11.266993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:11.289126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:11.482506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:11.493202 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-985b08d4-bfbd-4c88-a104-d99fd4409939 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.245174 Jun 06 14:24:11.494071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 111/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:11 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:12.023245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1395003970", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "networks": [{"uuid": "ba8a6d51-0856-4b11-b612-e03ba6d3288e"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:12.136869 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] validate_networks() for [('ba8a6d51-0856-4b11-b612-e03ba6d3288e', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:24:12.523586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:12.526448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:12.555820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:12.560265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:12.563363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:12.564006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:12.742299 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:24:12.742845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:24:12.743897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:24:12.744581 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:24:12.745108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:24:12.761600 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:12.762606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:12.765449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:12.768304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:12.777222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:12.785832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7253e571-8fc8-4d82-bc23-c9930115ff7d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.275813 Jun 06 14:24:12.790225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 112/201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:12 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:12.801533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Getting quotas for project 810c087aef3d453cb9c0365467dd9134. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:24:12.807816 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Getting quotas for user 66ded9372b644c57a9f13fc88ff7fdb6 and project 810c087aef3d453cb9c0365467dd9134. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:24:12.823578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:24:12.826486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:24:12.889091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8c5cb652-406c-4294-a322-3bc90543d810 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.881465 Jun 06 14:24:12.895133 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 90/202] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:24:12.900621 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-96ad8155-a7e2-4f74-abc1-ee222510571c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:12.901243 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-96ad8155-a7e2-4f74-abc1-ee222510571c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:12.992921 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-96ad8155-a7e2-4f74-abc1-ee222510571c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:13.004910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-96ad8155-a7e2-4f74-abc1-ee222510571c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1219 microversion: 2.1 time: 0.107921 Jun 06 14:24:13.019174 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 113/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:12 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:13.814749 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:13.820269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:13.860683 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:13.862651 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:13.864527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:13.866556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:14.035813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:14.036844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:14.042029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=40 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:14.053303 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:14.054868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:14.056508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:14.057528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:14.129734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:14.144057 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5ad13593-e077-4d12-8305-8d33b252babc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.342879 Jun 06 14:24:14.145418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 91/204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:13 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:14.157419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:14.189092 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-48ea8bcc-58e8-4248-805e-8b6f1296dfc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1271 microversion: 2.1 time: 0.159053 Jun 06 14:24:14.189912 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 114/205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:14 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:15.172412 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:15.173085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:15.175949 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:15.184062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:15.184593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:15.185492 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:15.186069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:15.213165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:15.214363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:15.225836 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:15.226659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:15.228206 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:15.229031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:15.344762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:15.358154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-43cce8e9-685d-4344-9723-8090f90b128b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1277 microversion: 2.1 time: 0.152028 Jun 06 14:24:15.359187 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 115/206] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:15 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:15.397676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:15.406273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8797e580-6d1c-4c95-9308-10f40d57414c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.238664 Jun 06 14:24:15.406874 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 92/207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:15 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:16.387918 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:16.391150 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:16.404472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:16.405984 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:16.408007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:16.409385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:16.430025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:16.431477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:16.460911 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:16.462940 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:16.465432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:16.466995 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:16.768499 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:16.784229 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a4cf679f-cc77-49e3-ac8e-c681a183c919 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.404282 Jun 06 14:24:16.784879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 116/208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:16 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:16.790678 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-a0b86fba-4bb9-44a9-a273-672046cf7df4 req-dd614656-7b82-40d6-bc36-8c73ff17cbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a09198a-932a-4172-91a9-6d0648e54f85", "tag": "46d8ff0b-6f53-4752-a775-f06a8d92aebb"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:16.809308 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:16.821292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2c06ae00-c63f-4e14-8ca5-8a0d98a6bf14 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.399608 Jun 06 14:24:16.822755 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 93/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:16 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:16.828440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a0b86fba-4bb9-44a9-a273-672046cf7df4 req-dd614656-7b82-40d6-bc36-8c73ff17cbe5 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:16.829608 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a0b86fba-4bb9-44a9-a273-672046cf7df4 req-dd614656-7b82-40d6-bc36-8c73ff17cbe5 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:16.856175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-a0b86fba-4bb9-44a9-a273-672046cf7df4 req-dd614656-7b82-40d6-bc36-8c73ff17cbe5 service nova] Creating event network-changed:46d8ff0b-6f53-4752-a775-f06a8d92aebb for instance 4a09198a-932a-4172-91a9-6d0648e54f85 on hv-cinder-84414 Jun 06 14:24:16.867313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-a0b86fba-4bb9-44a9-a273-672046cf7df4 req-dd614656-7b82-40d6-bc36-8c73ff17cbe5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081025 Jun 06 14:24:16.868489 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 117/210] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:17.811244 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:17.811937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:17.820044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:17.820497 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:17.821302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:17.821951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:17.843827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:17.844990 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:17.856672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:17.857390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:17.858788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:17.859492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:18.043297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:18.053601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3a27c74b-d8f9-46c2-9550-68ac4e0965fd tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.245712 Jun 06 14:24:18.054516 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 94/211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:17 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:18.074267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:18.090743 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b9a3fa26-cb05-4392-9e41-ddcedaf7da82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.253797 Jun 06 14:24:18.091786 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 118/212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:17 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:19.079543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:19.081970 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:19.094089 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:19.095329 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:19.097062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:19.098192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:19.113195 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:19.115041 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:19.127171 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:19.128406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:19.130238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:19.132426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:19.465260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:19.478460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5bb2d02f-5a5c-43b5-aed2-adcfbb28b6b4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.406143 Jun 06 14:24:19.479399 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 95/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:19 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:19.507242 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:19.519241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-76f89583-1a7f-4509-8b85-00e3524b5cc5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.413355 Jun 06 14:24:19.519905 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 119/214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:19 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:20.505184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:20.506291 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:20.513637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:20.514119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:20.514954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:20.515364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:20.542973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:20.544117 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:20.555932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:20.556893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:20.558203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:20.559013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:20.829986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:20.843948 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8fa22807-01d9-425a-9029-c76a4e93e571 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.343062 Jun 06 14:24:20.844788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 96/215] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:20 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:20.857610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:20.866930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2bacaf38-8537-4145-8bdd-85c0a85f7b66 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.332057 Jun 06 14:24:20.867717 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 120/216] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:20 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:21.866024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:21.866756 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:21.874019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:21.874462 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:21.875244 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:21.875679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:21.885535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:21.886414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:21.893992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:21.893992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:21.894503 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:21.894997 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:22.207710 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:22.216909 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-54b4d9fa-c24f-405c-990a-e1d40b32a672 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.354963 Jun 06 14:24:22.217510 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 97/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:21 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:22.231669 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:22.239874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-223f84e5-2cd5-429f-b220-06ae2eeb59f0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.358134 Jun 06 14:24:22.240772 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 121/218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:21 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:23.239051 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:23.241135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:23.243914 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:23.245071 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:23.257121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:23.257793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:23.257963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:23.258419 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:23.259878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:23.260061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:23.260643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:23.266239 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:23.267088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:23.267498 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:23.267938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:23.766442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:23.775181 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-233f3815-4da2-4a87-88ba-bf31f8f982ee tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.522494 Jun 06 14:24:23.775772 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 122/219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:23 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:23.779304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:23.793931 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f0c5fdeb-c449-42d4-a6de-5a7565b4086d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.561523 Jun 06 14:24:23.795408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 98/220] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:23 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:24.793213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:24.793952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:24.800578 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:24.801028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:24.801849 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:24.802358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:24.816614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:24.820123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:24.833102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:24.835608 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:24.837065 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:24.837885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:25.004290 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:25.018602 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-69a15f7e-3bc9-4893-acc8-4fab53a49c68 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.228796 Jun 06 14:24:25.019795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 123/221] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:24 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:25.069359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:25.087282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6f3843b0-cd53-4b7f-af49-3d96b97a548f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.277567 Jun 06 14:24:25.088355 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 99/222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:24 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:26.044351 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:26.044998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:26.051726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:26.052297 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:26.053942 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:26.054463 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:26.111745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:26.112739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:26.120644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:26.121356 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:26.122453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:26.123138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:26.281671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:26.291425 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3d8428be-a91b-4f94-bab9-56f4401210d8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.250922 Jun 06 14:24:26.292132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 124/223] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:26 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:26.317223 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:26.325312 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-93e7f6f4-13b4-45b7-bc46-6fbc43bf9310 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.220536 Jun 06 14:24:26.325957 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 100/224] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:26 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:26.951914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:26.954619 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:26.964275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:26.964976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:26.966212 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:26.966800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.002961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a36e4e3-0841-4f04-b83f-4fea164596e9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/ips" status: 200 len: 147 microversion: 2.1 time: 0.057541 Jun 06 14:24:27.003732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 125/225] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:24:26 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/ips => generated 147 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:27.218803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:27.219644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:27.227829 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.228590 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.229180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.230092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.236365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:27.257425 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-f405d4c6-c2d9-4946-bf3b-72304e9354fb req-9ef48a64-be75-4d87-b1e5-b21db7bf88dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a09198a-932a-4172-91a9-6d0648e54f85", "name": "network-vif-plugged", "status": "completed", "tag": "46d8ff0b-6f53-4752-a775-f06a8d92aebb"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:27.267550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-f405d4c6-c2d9-4946-bf3b-72304e9354fb req-9ef48a64-be75-4d87-b1e5-b21db7bf88dc service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.268289 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-f405d4c6-c2d9-4946-bf3b-72304e9354fb req-9ef48a64-be75-4d87-b1e5-b21db7bf88dc service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.273864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7b884fcc-e36f-435a-88da-ce4762b14a49 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/ips" status: 200 len: 151 microversion: 2.20 time: 0.058479 Jun 06 14:24:27.275037 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 101/226] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jun 6 14:24:27 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/ips => generated 151 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:24:27.291513 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-f405d4c6-c2d9-4946-bf3b-72304e9354fb req-9ef48a64-be75-4d87-b1e5-b21db7bf88dc service nova] Creating event network-vif-plugged:46d8ff0b-6f53-4752-a775-f06a8d92aebb for instance 4a09198a-932a-4172-91a9-6d0648e54f85 on hv-cinder-84414 Jun 06 14:24:27.297179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-f405d4c6-c2d9-4946-bf3b-72304e9354fb req-9ef48a64-be75-4d87-b1e5-b21db7bf88dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043986 Jun 06 14:24:27.298197 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 126/227] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:24:27.327181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:27.338350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:27.347777 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:27.349652 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:27.362243 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.363446 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.365668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.366758 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.372299 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.377381 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.379045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:27.379877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:27.666221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:27.687855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d9d3633c-ad0b-40e4-b7e8-289677b98e7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.346144 Jun 06 14:24:27.702218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 127/228] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:27 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:27.847325 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:27.865942 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-95bdeeb6-5fa8-4b03-8d8b-0f73a33c92c6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.547193 Jun 06 14:24:27.868062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 102/229] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:27 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:28.709544 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:28.710439 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:28.716951 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:28.717724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:28.718761 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:28.719206 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:28.890013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:28.894760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:28.927436 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:28.946132 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:28.947412 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:28.948175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:29.080825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:29.111436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4f27ddb8-c625-4e0f-be10-4f7560d46181 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1319 microversion: 2.1 time: 0.405880 Jun 06 14:24:29.116156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 128/230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:28 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:29.401357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:29.414151 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c76b91f9-79a5-452a-8bef-da1ad7edacaf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.532399 Jun 06 14:24:29.414897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 103/231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:28 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:30.019369 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:30.020694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:30.047064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.047784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.049115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.050061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.089681 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lazy-loading 'flavor' on Instance uuid d12d1c93-4204-4b5b-ab25-22a197f92d27 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:24:30.131889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:30.145503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:30.146839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:30.165897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.166954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.168682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.170003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.502216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:30.523613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9eafbf2b-8395-464f-a157-693b19870d80 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1508 microversion: 2.1 time: 0.383314 Jun 06 14:24:30.526285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 104/232] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:30 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:30.565462 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:30.569262 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:30.602089 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.602484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.607372 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.609133 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.634580 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-aecf9c8d-b65c-4521-8967-5c475f902274 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/action" status: 202 len: 0 microversion: 2.20 time: 0.620488 Jun 06 14:24:30.635327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 129/233] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 14:24:30 2022] POST /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:24:30.643480 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a9d597e-8738-40f1-8091-cdb50e5ddec3"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:30.645480 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:30.657809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.658553 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.659527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:30.660132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:30.983964 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:30.998973 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-76d3b34e-8dc1-48a6-a2d5-e7d2d0837ae8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.471165 Jun 06 14:24:31.000245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 105/234] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:30 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:31.011183 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:31.012496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:31.028833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:31.029573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:31.031026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:31.031958 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:31.352688 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:31.385493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:31.390870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:31.396452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-06baf627-4559-46c7-bbcd-2b57a3a9ac19 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.393032 Jun 06 14:24:31.400222 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 106/235] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:31 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:31.982128 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7eab7b3f-5bb6-4ac0-afa1-da4a99025c80 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.344275 Jun 06 14:24:31.982790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 130/236] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:24:30 2022] POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-volume_attachments => generated 194 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:32.031214 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:32.032390 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:32.052124 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:32.053357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:32.054812 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:32.055646 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:32.332595 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:32.341601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-36fb0df5-ae68-461b-b3ed-1584a2879711 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.326890 Jun 06 14:24:32.342243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 107/237] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:32 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:32.422802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:32.423957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:32.433580 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:32.434274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:32.435650 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:32.436301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:32.688865 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:32.702091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:32.704123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:32.705360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4e5e5376-cefb-4d00-98c8-dbaad4e3a743 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.290106 Jun 06 14:24:32.706585 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 131/238] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:32 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:33.371348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:33.372371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:33.386560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:33.390095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:33.391828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:33.392572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:33.741880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:33.743935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:33.747257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:33.761837 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:33.762955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:33.763267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-27aa633b-8bf4-40d5-84b2-336f50db497a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1522 microversion: 2.1 time: 0.399184 Jun 06 14:24:33.764445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 108/239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:33 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:33.775262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:33.775803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:34.053534 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:34.070384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:34.073914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:34.076278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ef33ca01-65cc-422b-ab2e-d18f47211091 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.343122 Jun 06 14:24:34.078207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 132/240] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:33 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:34.799196 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:34.802712 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:34.840205 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:34.841250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:34.844289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:34.845814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:35.088616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:35.098237 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:35.100166 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:35.111053 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:35.111868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:35.113057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:35.113798 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:35.122752 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-67adb8a9-63d9-4fe8-aaa6-fdfe587581a9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1502 microversion: 2.1 time: 0.318032 Jun 06 14:24:35.122752 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 109/241] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:34 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:35.154344 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:35.156250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:35.168514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:35.169442 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:35.171122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:35.172076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:35.390878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:35.424987 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:35.433803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:35.436123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-225715d9-2c99-4885-b60f-6490d0c7a258 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.343081 Jun 06 14:24:35.441845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 133/242] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:35 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:35.546706 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:35.574181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a08331d6-dbf2-47a8-9e1e-4c3e683507c9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1516 microversion: 2.1 time: 0.429160 Jun 06 14:24:35.575650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 110/243] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:35 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1516 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:36.461991 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:36.462760 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:36.470779 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:36.471257 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:36.472061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:36.472504 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:36.680891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:36.690653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:36.692365 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:36.693940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f766b746-fbeb-47e4-8d55-bc45e76f1f44 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.235943 Jun 06 14:24:36.694619 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 134/244] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:36 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:37.719947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:37.720551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:37.729812 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:37.730274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:37.731056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:37.731495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:37.883568 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:37.892159 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:37.893777 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:37.895001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ab7bdc99-9114-46af-b076-56f428cf1542 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.178995 Jun 06 14:24:37.896333 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 111/245] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:37 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:38.896610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-407274979", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "networks": [{"uuid": "a5c368c9-8cb1-4480-b4a0-661e9dc56b7c"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:38.926010 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:38.928662 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:38.940954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:38.941674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:38.943979 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:38.944652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:38.975185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] validate_networks() for [('a5c368c9-8cb1-4480-b4a0-661e9dc56b7c', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:24:39.199945 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:39.209130 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:39.210722 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:39.212265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-42d51ddb-3814-4161-b743-d90f75f3b562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.293159 Jun 06 14:24:39.223026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 112/246] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:38 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:39.361315 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:39.363264 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:39.374003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:39.378509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:39.379615 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:39.380093 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:39.420081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lazy-loading 'flavor' on Instance uuid b7272e33-1832-487c-9463-50a3efc67404 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:24:39.590843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-384c7216-ad5f-4652-bea1-2b9343cffa8a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/action" status: 200 len: 32 microversion: 2.1 time: 0.235023 Jun 06 14:24:39.597889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 113/247] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:24:39 2022] POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 14:24:39.619803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:39.621163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:39.633202 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:39.633813 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:39.634709 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:39.635187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:39.878171 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:24:39.879055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:24:39.880571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:24:39.881353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:24:39.882283 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:24:39.897894 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:39.899639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:39.901307 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:39.902312 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:39.939899 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Getting quotas for project 87c64a64f6864b84867141833e107e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:24:39.950968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Getting quotas for user 6197b2673c3e41eaac7ca07ad56aab1f and project 87c64a64f6864b84867141833e107e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:24:39.978277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:39.986923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:24:39.991837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a554ff91-3f1c-4d40-927d-a598762492a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.382748 Jun 06 14:24:39.992855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:24:39.993756 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 114/248] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:39 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:40.002798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa1af650-d2d9-440b-a022-6e7ddbb6bf09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:40.018959 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa1af650-d2d9-440b-a022-6e7ddbb6bf09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:40.019771 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa1af650-d2d9-440b-a022-6e7ddbb6bf09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:40.095632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-56ef5c25-3985-402e-9433-57a2b0ca69e1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.203008 Jun 06 14:24:40.102738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 135/249] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:24:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 14:24:40.127740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e29ff764-0f78-48b9-8857-d91aeaff3173 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:40.127740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e29ff764-0f78-48b9-8857-d91aeaff3173 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:40.150208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fa1af650-d2d9-440b-a022-6e7ddbb6bf09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Going to try to stop instance {{(pid=117604) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 14:24:40.168003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:40.225403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fa1af650-d2d9-440b-a022-6e7ddbb6bf09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action" status: 202 len: 0 microversion: 2.1 time: 0.224623 Jun 06 14:24:40.230986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 115/250] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:24:39 2022] POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:24:40.244064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:40.245955 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:40.254526 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:40.257445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:40.258947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:40.259734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:40.293115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e29ff764-0f78-48b9-8857-d91aeaff3173 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:40.305563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e29ff764-0f78-48b9-8857-d91aeaff3173 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1213 microversion: 2.1 time: 0.201045 Jun 06 14:24:40.308407 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 136/251] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:40 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:40.322428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:40.323635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:40.347217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:40.347703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:40.349175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:40.350943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:40.585843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:40.623518 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:40.627715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:40.631681 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:40.634705 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1f7749ab-65d8-4b0f-9959-f62746b9cb03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.401448 Jun 06 14:24:40.636197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 116/252] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:40 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:40.648705 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a2a4154a-0a8c-48c2-8994-9daca9fdf9cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.326512 Jun 06 14:24:40.649774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 137/253] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:40 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:41.011568 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:41.012185 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:41.019331 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.020109 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.021588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.022296 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.244687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:41.264847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-272c5f7b-5d8e-4d8e-a7d6-4fe91992d029 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.256701 Jun 06 14:24:41.266232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 117/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:41 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:41.334913 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:41.335647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:41.343011 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.343744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.344815 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.345322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.445234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:41.455665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2c18d534-dae0-414d-bafb-a6766eab7d89 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1265 microversion: 2.1 time: 0.125612 Jun 06 14:24:41.456254 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 138/255] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:41 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:41.661184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:41.662562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:41.672915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.673622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.674666 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.675252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.679332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:41.682423 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:41.696969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.699118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.700931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:41.703104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:41.990622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:42.009220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:42.012313 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:42.016649 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:42.018917 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-13a8c42e-8b7f-4e24-af68-b37cb221d4da tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.361702 Jun 06 14:24:42.019865 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a33eb3d-6593-4e8c-82a8-7b13bc6311d0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.350065 Jun 06 14:24:42.020197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 118/256] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:41 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:42.034025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 139/257] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:41 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:42.283673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:42.284384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:42.295833 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:42.296520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:42.297356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:42.298081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:42.481118 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:42.482886 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:42.496567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:42.505188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:42.506984 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:42.507799 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:42.601816 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:42.616689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-42ff090e-bd34-444c-8941-ce33be50b79b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.336425 Jun 06 14:24:42.618730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 140/258] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:42 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:42.640801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:42.664471 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e329456f-2a85-4187-9519-539fe44878d2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1271 microversion: 2.1 time: 0.192559 Jun 06 14:24:42.665810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 119/259] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:42 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:43.045961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:43.047813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:43.055562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:43.056417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:43.064663 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.066028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.066705 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.067489 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.068641 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.068841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.069656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.070656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.343647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:43.359347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8c858aaa-acba-49e1-903f-b12652c0d26f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.309936 Jun 06 14:24:43.370496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 120/260] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:43 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:43.397317 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:43.407790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:43.412149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:43.413686 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-24498946-c56e-4759-998b-b1a8479928f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.378966 Jun 06 14:24:43.425032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 141/261] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:43 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:43.638535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:43.639772 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:43.651629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.652954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.654766 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.655625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.683943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:43.686079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:43.697222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.698005 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:43.699255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:43.700064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:44.128345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:44.142959 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e9b9b5e8-ce4e-44b2-99f5-d52373b500a4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.509308 Jun 06 14:24:44.144386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 121/262] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:43 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:44.160565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ef55c568-1b91-4047-851d-a4b5d9722c9f req-41439a18-7835-4a01-8b1f-0d3a366f5e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39c4e948-99e9-425f-839a-b35ef6e4698b", "tag": "9ea64540-d1d9-4393-9e55-31bbb69c3144"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:44.171501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:44.181131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-23e3f2f1-2b9a-4cc9-8859-c65355d5c86b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1313 microversion: 2.1 time: 0.502019 Jun 06 14:24:44.181666 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ef55c568-1b91-4047-851d-a4b5d9722c9f req-41439a18-7835-4a01-8b1f-0d3a366f5e66 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:44.182545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ef55c568-1b91-4047-851d-a4b5d9722c9f req-41439a18-7835-4a01-8b1f-0d3a366f5e66 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:44.183274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 142/263] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:43 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:44.225307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ef55c568-1b91-4047-851d-a4b5d9722c9f req-41439a18-7835-4a01-8b1f-0d3a366f5e66 service nova] Creating event network-changed:9ea64540-d1d9-4393-9e55-31bbb69c3144 for instance 39c4e948-99e9-425f-839a-b35ef6e4698b on hv-cinder-84414 Jun 06 14:24:44.245585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-ef55c568-1b91-4047-851d-a4b5d9722c9f req-41439a18-7835-4a01-8b1f-0d3a366f5e66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097560 Jun 06 14:24:44.246246 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 122/264] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:44.381830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:44.383684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:44.390066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:44.402016 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:44.403403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:44.405146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:44.406271 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:44.437822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:44.438968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:44.452853 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:44.453307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:44.454150 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:44.458367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.247422 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:45.248425 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:45.257541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:45.259171 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:45.260466 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ebe4abf0-cb72-4b5d-8f8c-d56ac37991f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.829870 Jun 06 14:24:45.269980 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9135af90-27bc-402f-9ea3-e7b8ca4eb960 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.895152 Jun 06 14:24:45.274015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 123/265] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:44 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:45.279134 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:45.280352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:45.283379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=64 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:45.284704 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 143/266] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:44 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:45.296387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:45.297308 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:45.299199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:45.300141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.302077 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:45.302933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.324797 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:45.326177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.329257 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:45.332066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.670016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:45.698616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ce375fd2-65b3-4eab-8627-2ea69a9c0db4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.420330 Jun 06 14:24:45.699776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 124/267] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:45 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:45.719238 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:45.720103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:45.732018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:45.732877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.734125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:45.734980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:45.736412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:45.768062 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fee6ffed-3010-4ff6-949f-917244dde965 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1313 microversion: 2.1 time: 0.479503 Jun 06 14:24:45.771568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 144/268] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:45 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:45.796280 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a2c0333e-e35e-44eb-a47f-6fd1d65d4c2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/ips" status: 200 len: 151 microversion: 2.1 time: 0.094274 Jun 06 14:24:45.797948 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 125/269] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:24:45 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/ips => generated 151 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:46.308329 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:46.309298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:46.309298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:46.310098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:46.317676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.326239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.326239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.326239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.327845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.328387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.329337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.329854 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.389922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:46.791864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:46.831502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:46.845338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:46.847846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c8971660-23a8-4209-bee8-73e3d90de48f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.569041 Jun 06 14:24:46.855116 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 145/270] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:46 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:46.857736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:46.868131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:46.870279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:46.893165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.893835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b3a9b416-16f7-4f27-ad93-96803966f961 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.599636 Jun 06 14:24:46.894685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.897294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.897522 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 126/271] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:46 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:46.898673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.939242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:46.942081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:46.979165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.982066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:46.984489 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:46.986684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:47.336487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:47.357982 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4144efdd-50ca-4a8e-948d-5c2df461e8b2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.495400 Jun 06 14:24:47.359496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 146/272] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:46 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:47.421421 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:47.434122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d24fbce7-5180-40de-a8bb-01809d77c516 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1313 microversion: 2.1 time: 0.533608 Jun 06 14:24:47.434985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 127/273] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:46 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:47.538930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b32ec29c-ae54-4538-8e0a-c31b46056568"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:47.540879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:47.548670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:47.549792 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:47.550889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:47.552723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:47.892814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:47.894046 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:47.907792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:47.909200 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:47.914849 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:47.916502 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:47.957112 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-613a9b86-ade8-4c50-a53c-2c19d696b329 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423205 Jun 06 14:24:47.957824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 147/274] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:24:47 2022] POST /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:47.971566 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:47.974564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:47.986819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:47.988414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:47.994333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:47.995873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:48.320390 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:48.327109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:48.330999 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:48.333049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:48.334837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c80072ce-54b1-425a-8f16-0937d249fe7a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.450948 Jun 06 14:24:48.335901 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 128/275] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:47 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:48.343531 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d32f14d7-a852-45ab-8557-f197b759dfe6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.382885 Jun 06 14:24:48.350456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 148/276] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:47 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:48.379860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:48.380662 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:48.391035 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:48.391774 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:48.393101 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:48.394591 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:48.458893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:48.460144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:48.469288 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:48.470057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:48.471390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:48.472207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:48.730879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:48.747263 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-33bf04d2-84bf-47c4-ae88-eb9adcf0d040 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.372823 Jun 06 14:24:48.748762 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 129/277] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:48 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:48.764159 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:48.778436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-500f11d4-fd06-4104-91b9-7b9fc14b29d1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1313 microversion: 2.1 time: 0.328106 Jun 06 14:24:48.779502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 149/278] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:48 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:49.369533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:49.371254 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:49.374696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:49.376454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:49.383416 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.384717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.385670 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.386323 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.390220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.393766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.393766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.393766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.674402 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:49.685284 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:49.685606 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:49.687618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:49.689461 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4c333edb-0c17-442a-85ce-47e9e6fc821f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.326421 Jun 06 14:24:49.690145 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 130/279] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:49 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:49.697383 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-48306a0a-6fb7-435f-8398-beee9380a3cd req-48b6083c-27c9-4e3b-afa2-6077ff70b4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c4e948-99e9-425f-839a-b35ef6e4698b", "name": "network-vif-plugged", "status": "completed", "tag": "9ea64540-d1d9-4393-9e55-31bbb69c3144"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:49.697748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-525e29b6-4f9d-4978-aa61-bad42ddaa981 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.333452 Jun 06 14:24:49.698384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 150/280] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:49 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:49.713627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-48306a0a-6fb7-435f-8398-beee9380a3cd req-48b6083c-27c9-4e3b-afa2-6077ff70b4e1 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.714287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-48306a0a-6fb7-435f-8398-beee9380a3cd req-48b6083c-27c9-4e3b-afa2-6077ff70b4e1 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.730291 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-48306a0a-6fb7-435f-8398-beee9380a3cd req-48b6083c-27c9-4e3b-afa2-6077ff70b4e1 service nova] Creating event network-vif-plugged:9ea64540-d1d9-4393-9e55-31bbb69c3144 for instance 39c4e948-99e9-425f-839a-b35ef6e4698b on hv-cinder-84414 Jun 06 14:24:49.736051 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-48306a0a-6fb7-435f-8398-beee9380a3cd req-48b6083c-27c9-4e3b-afa2-6077ff70b4e1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044390 Jun 06 14:24:49.737265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 131/281] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:49.779458 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:49.780344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:49.789960 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.790664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.791481 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.791949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.819523 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:49.820918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:49.830309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.831420 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.833537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:49.834535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:49.921889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:50.080824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:50.098231 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-11bc334e-536a-4cbb-a7b1-3af9ae973402 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.322584 Jun 06 14:24:50.124929 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 151/282] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:49 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:50.178780 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:50.194357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3b67ef99-d83c-42fc-aa7e-47b0477123b3 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1313 microversion: 2.1 time: 0.378727 Jun 06 14:24:50.195556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 132/283] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:49 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:50.713543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:50.714719 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:50.717935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=8 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:50.721016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:50.722081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:50.728060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:50.728827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:50.730388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:50.731166 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:50.733814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:50.734439 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:50.735609 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:50.736551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:50.766460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:50.976931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:50.987983 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:50.993527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:50.996308 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:50.998403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ea1e591d-941c-460d-9a22-fd499cf87a3f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.289720 Jun 06 14:24:51.002048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-392b4386-e6bb-4205-b7e3-eebb762b9052 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.287527 Jun 06 14:24:51.003376 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 133/284] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:50 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:51.005915 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 152/285] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:50 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:51.134286 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:51.135092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:51.141609 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:51.142092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:51.142980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:51.143499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:51.217056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:51.217977 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:51.226628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:51.226899 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:51.227660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:51.228112 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:51.373638 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:51.394703 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-90321f2c-fc5f-48d5-a84b-a28365482d06 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.263745 Jun 06 14:24:51.396190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 134/286] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:51 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:51.486311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:51.499969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ac340007-731c-41eb-bb7c-e70923b4e926 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1313 microversion: 2.1 time: 0.288336 Jun 06 14:24:51.500627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 153/287] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:51 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:52.031252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:52.031905 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:52.032507 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:52.034051 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:52.048891 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.050283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.050520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.053275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.053955 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.055096 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.055322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.056874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.423191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:52.424503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:52.447301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5355cd72-7ad7-478e-a907-3f0f94fead48 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.421628 Jun 06 14:24:52.448428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 154/288] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:52 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:52.448803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:52.452200 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:52.454835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1ced6ca7-f0c0-4efe-83a3-d21708f43e27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.431304 Jun 06 14:24:52.457880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 135/289] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:52 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:52.475787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:52.477199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:52.487911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.488942 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.489877 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.490571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.525926 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:52.526804 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:52.537556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.538582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.540201 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:52.540811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:52.735336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:52.749058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7d7fc2d2-a9c6-4c82-b83c-dbf77ebf4db7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.281822 Jun 06 14:24:52.749953 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 155/290] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:52 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:52.779424 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:52.790122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3437f54f-adcd-45dd-9632-08af9ae5218d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1497 microversion: 2.1 time: 0.270304 Jun 06 14:24:52.790825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 136/291] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:52 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1497 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:53.481071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:53.481698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:53.496241 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:53.500250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:53.509172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.512178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.516243 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.517139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.529088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.530029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.533327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.538013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.862998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:53.868665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:53.879041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:53.881558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:53.882989 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1acd6834-7d22-413b-b91c-81c735301820 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1745 microversion: 2.20 time: 0.397310 Jun 06 14:24:53.884087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 137/292] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:53 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1745 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:53.885504 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e47ddc5c-0ec1-489e-b3b3-212133849eaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.413570 Jun 06 14:24:53.890285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "620581dd-db3a-46a8-82c7-07f447406c7d", "device": "/dev/sdb"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:53.892242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:53.899038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 156/293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:53 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:53.903524 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.904247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.905503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.906095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.926750 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:53.927624 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:53.942460 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.943257 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.945420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:53.946852 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:53.986978 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:24:54.124064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-439e29a2-c88e-4ac5-a9b9-0c9c5921f594 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "DELETE /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 204 len: 0 microversion: 2.1 time: 0.222092 Jun 06 14:24:54.124935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 157/294] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:24:53 2022] DELETE /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:24:54.131303 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:54.133412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:54.141235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:54.141688 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:54.142521 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:54.142957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:54.371484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:54.383109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f0843e0d-0325-4f81-8752-592d398082af tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.256936 Jun 06 14:24:54.384029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 158/295] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:54 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:54.390808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:54.392033 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:54.402113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:54.402566 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:54.403807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:54.404370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:54.408985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:54.581960 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:54.592250 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ff395784-1f68-41f3-b626-94ce2c6e9e2f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1503 microversion: 2.1 time: 0.206565 Jun 06 14:24:54.592833 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 159/296] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:54 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:54.906763 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:54.907237 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:54.915576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:54.915576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:54.915925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:54.916435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.076295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:55.085652 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:55.087187 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:55.088381 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-244ba246-339b-4483-9985-640abd041d82 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1745 microversion: 2.20 time: 0.186088 Jun 06 14:24:55.088957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 160/297] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:54 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:55.093573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:55.094219 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:55.101731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:55.102191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.102976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:55.103417 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.266328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:55.278345 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-03568198-d755-48b2-9001-6799244fee9f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.188266 Jun 06 14:24:55.279764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 161/298] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:55 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:55.414341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:55.415640 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:55.423456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:55.424048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.425204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:55.426030 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.645791 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:55.665280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a216ee98-b5ea-4e4e-bb3e-56e236ec3e4a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.256480 Jun 06 14:24:55.666378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 162/299] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:55 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:55.674580 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:55.676148 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:55.688996 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:55.689754 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.691767 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:55.692589 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:55.967908 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:55.982394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-971dbdb0-5eaa-46ec-b5ff-599a88f5e3bc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1503 microversion: 2.1 time: 0.313952 Jun 06 14:24:55.983372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 163/300] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:55 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1503 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:56.110717 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:56.111338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:56.118074 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:56.118523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:56.119330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:56.119767 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:56.272275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:56.281137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:56.282858 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:56.284058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7773db17-bd60-4e2d-81f2-45d473b17430 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1745 microversion: 2.20 time: 0.177503 Jun 06 14:24:56.284623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 164/301] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:56 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:56.300516 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:56.301931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:56.309740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:56.310193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:56.310981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:56.311411 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:56.478549 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:56.487791 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-79c628ff-a5f1-4d8a-ba37-7f5d82dd2d8e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.191432 Jun 06 14:24:56.488373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 165/302] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:56 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:56.699429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:56.700527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:56.714090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:56.714845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:56.716353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:56.717489 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:56.920801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:56.933689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-df7eaf92-e2c7-4e68-b02c-ca3484cc5851 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.243329 Jun 06 14:24:56.935015 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 166/303] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:56 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:57.002089 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:57.002596 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:57.009655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.010466 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.011276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.011721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.179287 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:57.191074 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0fc58e55-f7c7-41bb-b24d-98886d6d155e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1503 microversion: 2.1 time: 0.192614 Jun 06 14:24:57.192151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 167/304] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:56 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:57.315180 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:57.315838 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:57.323275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.323795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.324660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.325102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.529571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:57.539225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:57.540795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:57.542335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fd172615-7c33-4a7c-97f2-3ae5e496bb31 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1745 microversion: 2.20 time: 0.231710 Jun 06 14:24:57.542894 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 168/305] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:57 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1745 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:24:57.547825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:57.548707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:57.557227 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.557691 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.558701 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.559145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.716435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:57.726545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5649b08a-20dc-4cbb-a5c5-c2f5809a1b08 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.182582 Jun 06 14:24:57.727129 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 169/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:57 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:57.732050 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-30666a0b-563e-4d5e-b0bf-4e89f22acdc8 req-6625ce97-7d51-4822-a600-1e5c54064a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "name": "network-vif-plugged", "status": "completed", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:24:57.741904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-30666a0b-563e-4d5e-b0bf-4e89f22acdc8 req-6625ce97-7d51-4822-a600-1e5c54064a99 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.742344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-30666a0b-563e-4d5e-b0bf-4e89f22acdc8 req-6625ce97-7d51-4822-a600-1e5c54064a99 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.756134 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-30666a0b-563e-4d5e-b0bf-4e89f22acdc8 req-6625ce97-7d51-4822-a600-1e5c54064a99 service nova] Creating event network-vif-plugged:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:24:57.762590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-30666a0b-563e-4d5e-b0bf-4e89f22acdc8 req-6625ce97-7d51-4822-a600-1e5c54064a99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033758 Jun 06 14:24:57.763646 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 170/307] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:24:57.953642 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:57.954505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:57.962444 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.962946 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:57.963780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:57.964358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.143868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:58.154182 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bec91f8f-9529-4b7d-95c2-2552c91a9258 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.205076 Jun 06 14:24:58.154982 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 171/308] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:57 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:58.210784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:58.211562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:58.219634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:58.220160 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.221092 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:58.221830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.434665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:58.444519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6eacccd0-cb35-49b1-8227-86562bdb878f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1503 microversion: 2.1 time: 0.238848 Jun 06 14:24:58.454669 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 172/309] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:58 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:58.584578 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:58.585341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:58.595510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:58.596092 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.597048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:58.598599 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.775729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:58.787523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:58.789353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:58.790758 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8c0b3a73-2b4e-4c98-9b5d-15987221d3e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1745 microversion: 2.20 time: 0.219984 Jun 06 14:24:58.793853 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 173/310] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:58 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:24:58.797846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:58.798787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:58.814640 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:58.815348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.816159 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:58.816635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:58.982347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:58.992190 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bb7595bb-02a8-4001-a70a-0de8b9a83382 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.199425 Jun 06 14:24:58.992775 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 174/311] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:58 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:24:59.181256 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:59.181764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:59.188770 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:59.189235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:59.190097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:59.190546 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:59.397215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:59.407091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ffd30eda-0164-4503-bcae-808b4ea45abf tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.230941 Jun 06 14:24:59.410121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 175/312] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:59 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:59.466714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:59.467216 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:59.475133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:59.475642 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:59.476470 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:59.477059 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:59.495981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:24:59.673510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:24:59.684150 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3c186288-de60-428e-a9cc-ba5c59b2ea18 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1503 microversion: 2.1 time: 0.222663 Jun 06 14:24:59.684855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 176/313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:24:59 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:24:59.819528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:24:59.821307 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:24:59.828898 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:59.830570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:59.831762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:24:59.833173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:24:59.845300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cabd59d8-63e3-4a6b-a361-1366d884e19c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "POST /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.959388 Jun 06 14:24:59.851428 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 138/314] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:24:53 2022] POST /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85/os-volume_attachments => generated 194 bytes in 5967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:00.017434 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:00.019011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:00.032900 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.033622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.035019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.036758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.115279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:00.153365 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:00.158948 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:00.164910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fddb7987-a24b-4753-a751-0801c680bc50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1745 microversion: 2.20 time: 0.348909 Jun 06 14:25:00.169896 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 177/315] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:24:59 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1745 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:00.436491 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:00.444565 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:00.470339 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.479285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.481880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:00.482762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.484138 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.500357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-200f7617-8838-4018-815e-6a00888d741f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.491647 Jun 06 14:25:00.501250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 139/316] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:00 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:00.686938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:00.697945 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-86ab2441-fd79-4fd4-b78b-917571e15bb9 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.271583 Jun 06 14:25:00.698972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 178/317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:00 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:00.706851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:00.707939 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:00.716222 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.716818 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.717821 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.718314 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.799750 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:00.807985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-eab1fb80-6228-4908-b490-7d2087d22012 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1461 microversion: 2.1 time: 0.107062 Jun 06 14:25:00.816153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 140/318] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:00 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1461 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:00.868656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-a0c62128-6212-4979-955b-cd7c8620a148 req-835de6b9-41a6-4aa7-8105-17ad040e71ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39c4e948-99e9-425f-839a-b35ef6e4698b", "name": "network-vif-deleted", "tag": "9ea64540-d1d9-4393-9e55-31bbb69c3144"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:00.877381 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a0c62128-6212-4979-955b-cd7c8620a148 req-835de6b9-41a6-4aa7-8105-17ad040e71ca service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:00.877845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a0c62128-6212-4979-955b-cd7c8620a148 req-835de6b9-41a6-4aa7-8105-17ad040e71ca service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:00.890690 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-a0c62128-6212-4979-955b-cd7c8620a148 req-835de6b9-41a6-4aa7-8105-17ad040e71ca service nova] Creating event network-vif-deleted:9ea64540-d1d9-4393-9e55-31bbb69c3144 for instance 39c4e948-99e9-425f-839a-b35ef6e4698b on hv-cinder-84414 Jun 06 14:25:00.896663 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-a0c62128-6212-4979-955b-cd7c8620a148 req-835de6b9-41a6-4aa7-8105-17ad040e71ca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031850 Jun 06 14:25:00.897295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 179/319] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:01.195934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:01.196907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:01.204438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.204861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.205635 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.206092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.354136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:01.363494 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:01.365106 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:01.366404 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-404dc982-63ae-4c87-aeb6-a20f6d4a7dd5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.175017 Jun 06 14:25:01.366983 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 141/320] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:01 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:01.524492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:01.525406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:01.534997 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.535636 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.536697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.537274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.709655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:01.716015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:01.716627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:01.724005 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.724451 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.725237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.725393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-837f78f5-447c-46ef-8f11-7240f0743d9c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.208668 Jun 06 14:25:01.725668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.726471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 180/321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:01 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:01.832583 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:01.833752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:01.844946 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.845559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.846542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:01.847119 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:01.892119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:01.908168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-57ca45bf-dcb3-4663-bb21-4e20596dc334 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.195678 Jun 06 14:25:01.909225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 142/322] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:01 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:01.921588 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:01.933463 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e7ed7f46-2d66-4dc7-876a-46976cf7b0cc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1461 microversion: 2.1 time: 0.109018 Jun 06 14:25:01.934305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 181/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:01 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:02.384995 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:02.385547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:02.392564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.393016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.393843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.394285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.557594 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:02.568629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:02.570792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:02.572050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-85a2e3f1-2461-4fcf-acd3-3310df3c0c30 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.191141 Jun 06 14:25:02.575702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 143/324] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:02 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:02.754488 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:02.755611 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:02.767343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.768199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.770296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.771096 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.927773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:02.936903 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:02.937531 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:02.939950 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-af87e8c9-4136-4c3b-9e13-9a96396b6f24 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.192429 Jun 06 14:25:02.940699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 182/325] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:02 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:02.945758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.946136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.946933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.947359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.953121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:02.953749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:02.960955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.961427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:02.962225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:02.962652 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:03.058029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:03.067652 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b3f152f3-dbf7-49e1-a546-80891fc295a5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1461 microversion: 2.1 time: 0.117624 Jun 06 14:25:03.068564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 183/326] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:02 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1461 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:03.132080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:03.140281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-38808a2c-bedd-4e69-bb9f-dd82ad951c7a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.207859 Jun 06 14:25:03.140895 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 144/327] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:02 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:03.607372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:03.608418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:03.620122 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:03.620875 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:03.622443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:03.623320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:03.781646 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:03.791514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:03.793163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:03.794447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-26dd5d0b-1b6d-464a-bf7b-7630e4e2fab5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.194889 Jun 06 14:25:03.795091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 184/328] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:03 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:03.963829 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:03.964441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:03.971595 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:03.972048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:03.973507 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:03.974003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:04.086131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:04.087405 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:04.095767 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:04.096227 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:04.097077 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:04.098235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:04.137538 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:04.154658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-eb671b27-fc99-46aa-9788-d549c569cec8 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1725 microversion: 2.1 time: 0.194088 Jun 06 14:25:04.158924 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 145/329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:03 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:04.173847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:04.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:04.181904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:04.187847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:04.188653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:04.190092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:04.190876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:04.192136 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-84c66eab-725c-4f77-a5d8-70954a817162 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1461 microversion: 2.1 time: 0.110860 Jun 06 14:25:04.192944 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 185/330] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:04 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:04.369997 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:04.378421 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fe93fd4f-7de1-45a6-bc9f-8d6b3f1ffad4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.214646 Jun 06 14:25:04.379540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 146/331] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:04 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:04.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:04.830623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:04.855244 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:04.855827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:04.856792 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:04.859771 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.058523 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1ac6c99f-414c-4eac-b041-b5a0eac64905 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: .version_select at 0x7fae9010bc10>, body: {"keypair": {"name": "tempest-keypair-1815231813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzW1zlhcWD+8oWbMPQg2V7A++eZWj6pYkZqiqKgIxVu0P4HbGsM72aJ1zE7AMmeTzLBSqmWRGaPvMGc86T89n8dwrGvAKRrCjWKSBOxJgmnlnRkR/WfiienfK6LjCqgUg=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:05.090850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:05.091735 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-1ac6c99f-414c-4eac-b041-b5a0eac64905 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:25:05.096482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-1ac6c99f-414c-4eac-b041-b5a0eac64905 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:25:05.110340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:05.114116 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:05.116655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ea8de920-3a28-442e-9359-2d264c236889 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.304824 Jun 06 14:25:05.118408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 186/332] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:04 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:05.134809 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1ac6c99f-414c-4eac-b041-b5a0eac64905 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083188 Jun 06 14:25:05.135961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 147/333] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:25:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:05.198296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:05.202326 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:05.210467 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:05.211114 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:05.230184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.230664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.230869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.231638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.231759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.232155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.234028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.234797 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.321812 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.323250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.325436 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lazy-loading 'fault' on Instance uuid 39c4e948-99e9-425f-839a-b35ef6e4698b {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:25:05.419756 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:05.440340 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f08d23b4-c77d-42f5-beb6-85d17176e957 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1303 microversion: 2.1 time: 0.233268 Jun 06 14:25:05.450719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 148/334] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:05 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:05.463370 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:05.464048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:05.474844 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.475321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.476540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.477019 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.501247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:05.612214 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:05.624262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1934db25-b79b-49c4-98dd-8a71d0082367 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1702 microversion: 2.1 time: 0.441927 Jun 06 14:25:05.625188 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 187/335] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:05 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1702 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:05.651575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-75d61b49-ad29-48b2-818d-200e0b85e577 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:05.661948 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75d61b49-ad29-48b2-818d-200e0b85e577 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.662855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75d61b49-ad29-48b2-818d-200e0b85e577 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.788909 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-75d61b49-ad29-48b2-818d-200e0b85e577 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Going to try to start instance {{(pid=117603) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 14:25:05.790876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:05.807886 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d67781ad-2942-4a15-9109-c335ff663fd0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.355539 Jun 06 14:25:05.808922 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 149/336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:05 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:05.875177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-75d61b49-ad29-48b2-818d-200e0b85e577 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action" status: 202 len: 0 microversion: 2.1 time: 0.227066 Jun 06 14:25:05.877067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 188/337] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:25:05 2022] POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:25:05.891793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:05.892885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:05.905673 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.906404 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:05.908283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:05.909580 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.139302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:06.145195 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:06.146507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:06.151533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c016c426-515e-4a8f-8e62-4dbee47edc09 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1711 microversion: 2.1 time: 0.267103 Jun 06 14:25:06.153736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 150/338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:05 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1711 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:06.169279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.170172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.171347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.172126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.434537 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:06.487480 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:06.491215 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:06.496063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:06.499714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:06.502727 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e71bacce-4e61-4d41-89d2-58ca4969b894 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.367759 Jun 06 14:25:06.505486 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 189/339] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:06 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:06.535870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.536967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.538442 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.539692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.649050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.649806 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.652624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lazy-loading 'fault' on Instance uuid 39c4e948-99e9-425f-839a-b35ef6e4698b {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:25:06.771128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:06.786422 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cdc6fcc2-0cbf-4d30-80d7-bbdb2362a13d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1303 microversion: 2.1 time: 0.321058 Jun 06 14:25:06.787365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 151/340] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:06 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:06.841755 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:06.845036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:06.856254 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:06.881780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.884302 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:06.888231 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:06.891054 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.194981 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:07.196518 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:07.244357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.245432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.247109 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.247754 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.309358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:07.351063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f248db65-8dbd-4c1f-87ab-81ff6321f595 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.519705 Jun 06 14:25:07.352191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 190/341] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:06 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:07.539670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:07.543072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:07.560008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.562965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.568380 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.569563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.612876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:07.637374 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ec62b1f4-958d-483d-9df0-2d26e8ca56b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1711 microversion: 2.1 time: 0.461659 Jun 06 14:25:07.648862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 152/342] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:07 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1711 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:07.824978 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:07.826554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:07.871544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.877074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.883984 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.884908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.948903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:07.960698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:07.970365 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:07.975921 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-674392c5-2a75-495f-b5f0-7307a77defce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.446169 Jun 06 14:25:07.984357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 191/343] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:07 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:07.993306 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:07.993905 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:07.999386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lazy-loading 'fault' on Instance uuid 39c4e948-99e9-425f-839a-b35ef6e4698b {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:25:08.121972 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:08.143225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-07a57a68-d094-4268-8deb-8c10efaa08c0 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 200 len: 1303 microversion: 2.1 time: 0.329987 Jun 06 14:25:08.167234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 153/344] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:07 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 1303 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:08.370965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:08.372144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:08.380675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:08.381230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:08.382156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:08.382665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:08.574691 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427605093", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c80cddf-8aa7-4709-b4d4-0401b235b6d1"}], "security_groups": [{"name": "tempest-securitygroup--1459258311"}], "key_name": "tempest-keypair-1815231813", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:08.799287 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:08.812296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:08.839058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c8de5c2f-26ee-43d4-9829-c0f17d2c5ef2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.471987 Jun 06 14:25:08.841744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 192/345] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:08 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:08.852988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:08.868141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:08.893262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:08.896233 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:08.912928 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:08.913845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:08.940469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] validate_networks() for [('5c80cddf-8aa7-4709-b4d4-0401b235b6d1', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:25:09.484609 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:09.545944 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c22e5189-a06e-4252-8064-0d8d24204728 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1711 microversion: 2.1 time: 0.702130 Jun 06 14:25:09.547155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 193/346] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:08 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1711 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:09.566896 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:09.569118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:09.606646 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:09.607885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:09.609245 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:09.609794 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.175369 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:10.187856 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:10.189750 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:10.194396 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d7f34a9-ff93-4e6f-ae20-6f62555da553 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.645460 Jun 06 14:25:10.195278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 194/347] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:09 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:10.209164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:10.210370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: 39c4e948-99e9-425f-839a-b35ef6e4698b] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:10.227687 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.228586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.236283 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.237088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.275745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:25:10.276838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:25:10.277512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:25:10.278140 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:25:10.278750 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:25:10.293457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] HTTP exception thrown: Instance 39c4e948-99e9-425f-839a-b35ef6e4698b could not be found. Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Request method failure captured: Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b HTTP/1.1 Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing4iTnBidUwlTyEbK99zqOeQWxGNILsZvBOrgq4hWc3P7c6C2ZLbQbeflUQDemAv7xvpv3BXhA14zT0PkoAprJnFiyB44ErXXH0OXU3ztU-69ZULy_GmVMNx1IvdOZ94WyZYFVl9OMiD3Z5bXvESoP61QaO3jzbOxsM2WYOL_iODx4c Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 87c64a64f6864b84867141833e107e9f Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesActionsTest-1748672813 Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:25:10.300230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/87c64a64f6864b84867141833e107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/87c64a64f6864b84867141833e107e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_87c64a64f6864b84867141833e107e9f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/87c64a64f6864b84867141833e107e9f"}]}] Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesActionsTest-1748672813 Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 87c64a64f6864b84867141833e107e9f Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesActionsTest-1748672813 Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesActionsTest-1748672813-project Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 6197b2673c3e41eaac7ca07ad56aab1f Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesActionsTest-1748672813-project Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 39c4e948-99e9-425f-839a-b35ef6e4698b could not be found. Jun 06 14:25:10.301983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '39c4e948-99e9-425f-839a-b35ef6e4698b'} Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39c4e948-99e9-425f-839a-b35ef6e4698b could not be found. Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:25:10.302989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39c4e948-99e9-425f-839a-b35ef6e4698b could not be found. Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39c4e948-99e9-425f-839a-b35ef6e4698b could not be found. Jun 06 14:25:10.304155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:25:10.307640 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.309486 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Returning 404 to user: Instance 39c4e948-99e9-425f-839a-b35ef6e4698b could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:25:10.310775 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fc7f2905-06f6-4721-8242-556ad4b4148b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b" status: 404 len: 111 microversion: 2.1 time: 0.108039 Jun 06 14:25:10.312839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.313745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 195/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:10 2022] GET /compute/v2.1/servers/39c4e948-99e9-425f-839a-b35ef6e4698b => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:25:10.315151 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.326753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.344966 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:10.359731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:10.382514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.389002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.390322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.394353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.423319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:25:10.431478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:25:10.493074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:25:10.495825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:25:10.627080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-22ca3a03-00f4-45ce-aeb1-b737ac13a141 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.090631 Jun 06 14:25:10.632065 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 154/349] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:25:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:25:10.659731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:10.667049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:10.735505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:10.746243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.748389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-90295037-3ac0-4f43-8651-b21332ebe150 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1502 microversion: 2.1 time: 0.422546 Jun 06 14:25:10.749951 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 196/350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:10 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:10.750616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.752112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:10.752929 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:10.773063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e1a1e2f2-c84a-4156-a1a9-78e5fb2413a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:10.774504 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e1a1e2f2-c84a-4156-a1a9-78e5fb2413a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:10.867021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e1a1e2f2-c84a-4156-a1a9-78e5fb2413a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:10.882101 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e1a1e2f2-c84a-4156-a1a9-78e5fb2413a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1242 microversion: 2.1 time: 0.130361 Jun 06 14:25:10.884745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 197/351] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:10 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:10.898508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1300399178", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "networks": [{"uuid": "a5c368c9-8cb1-4480-b4a0-661e9dc56b7c"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:11.055465 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] validate_networks() for [('a5c368c9-8cb1-4480-b4a0-661e9dc56b7c', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:25:11.893317 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:11.909515 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ad1d0739-84e5-453e-878b-29a59d0917fe tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1711 microversion: 2.1 time: 1.276146 Jun 06 14:25:11.917776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 155/352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:10 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1711 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:11.923267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "601bea0f-9d60-4048-b5e0-13337d2c58ff"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:11.938828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:11.975128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:11.984180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:11.986913 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:11.990430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.066068 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] HTTP exception thrown: Cannot 'attach_volume' instance b7272e33-1832-487c-9463-50a3efc67404 while it is in vm_state rescued Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Request method failure captured: Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/os-volume_attachments HTTP/1.1 Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 74 Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing26LYqRK8mDvncmOjod4lEogL9ReU4MHXEE4Cd1AWDJgdZbamX_Nz8dmwL9DkSO8vD0b4fdm8sCryBJV9nj5P4Kd_wWgZ_2KKDlhoOCRZH9zyQgcusKXTa162H1DuVz3xLUYN_YX4lvBlS5SUyMdwKuAK9Q1dXYNNBlzPYoxGjOLbc Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:25:12.068288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5e2e414f37bf4a89ac18e1836c793b0b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}] Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 86f9bcac527c45d6bc81b70e26544924 Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {"volumeAttachment": {"volumeId": "601bea0f-9d60-4048-b5e0-13337d2c58ff"}} Jun 06 14:25:12.069787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Cannot 'attach_volume' instance b7272e33-1832-487c-9463-50a3efc67404 while it is in vm_state rescued Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'server_id': 'b7272e33-1832-487c-9463-50a3efc67404', 'body': {'volumeAttachment': {'volumeId': '601bea0f-9d60-4048-b5e0-13337d2c58ff'}}} Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b7272e33-1832-487c-9463-50a3efc67404 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:25:12.070570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b7272e33-1832-487c-9463-50a3efc67404 while it is in vm_state rescued Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:25:12.071721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:25:12.072840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:25:12.072840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:25:12.072840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b7272e33-1832-487c-9463-50a3efc67404 while it is in vm_state rescued Jun 06 14:25:12.072840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:12.076511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Returning 409 to user: Cannot 'attach_volume' instance b7272e33-1832-487c-9463-50a3efc67404 while it is in vm_state rescued {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:25:12.078640 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d3a4a48a-46ca-4cc9-aeea-0c8c8bbf8b9d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.159513 Jun 06 14:25:12.079474 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 156/353] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:25:11 2022] POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/os-volume_attachments => generated 152 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 14:25:12.086227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:12.087333 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:12.097992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.098887 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.099956 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.100618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.511944 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:25:12.512626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:25:12.513132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:25:12.513548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:25:12.513993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:25:12.525366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.526218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.527428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.528170 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.562871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Getting quotas for project 87c64a64f6864b84867141833e107e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:25:12.584557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Getting quotas for user 6197b2673c3e41eaac7ca07ad56aab1f and project 87c64a64f6864b84867141833e107e9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:25:12.626716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:12.651372 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:12.653344 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:12.654786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5d5e05b1-0d01-4c44-b6f5-72384ef745f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.574138 Jun 06 14:25:12.655553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 157/354] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:12 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:12.658747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:25:12.664333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:25:12.669679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:12.670680 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:12.672992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:12.681384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.682177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.683220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.683838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.793860 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0a25ad6e-f720-4abf-8a52-784e477cffc6 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905189 Jun 06 14:25:12.803285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 198/355] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:25:12.864085 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:12.866689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:12.890988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:12.892222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.894027 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.896464 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:12.897060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:12.935546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a52e3c2a-7f5b-4d4d-bec0-02dbc33901cb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1238 microversion: 2.1 time: 0.275112 Jun 06 14:25:12.943047 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 158/356] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:12 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1238 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:12.985854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7cb906fa-417a-4328-ad48-2f0603c6a94e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:12.989473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7cb906fa-417a-4328-ad48-2f0603c6a94e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:13.046408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0406101e-5b4e-490a-89d7-0546eb3264a7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/action" status: 202 len: 0 microversion: 2.1 time: 0.226156 Jun 06 14:25:13.052623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 199/357] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:25:12 2022] POST /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:25:13.065260 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:13.066125 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:13.073503 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:13.074094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:13.075164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:13.075715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:13.255394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7cb906fa-417a-4328-ad48-2f0603c6a94e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:13.271176 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7cb906fa-417a-4328-ad48-2f0603c6a94e tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1214 microversion: 2.1 time: 0.326132 Jun 06 14:25:13.272921 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 159/358] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:12 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:13.281793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:13.282609 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:13.301883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:13.303873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:13.305837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:13.306777 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:13.397922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:13.418289 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-166e6bf7-c0b1-4d0b-be1d-f2bef17343a3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1711 microversion: 2.1 time: 0.359894 Jun 06 14:25:13.419603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 200/359] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:13 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1711 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:13.680336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:13.681318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:13.694382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:13.694841 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:13.695654 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:13.696107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:13.965212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:13.976761 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d47799cf-287c-4820-a60c-1352b49e7dba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1510 microversion: 2.1 time: 0.701617 Jun 06 14:25:13.978278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 160/360] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:13 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1510 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:13.996207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:13.997168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:14.006553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:14.007592 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:14.009118 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:14.010035 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:14.055957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:14.068386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:14.078029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:14.079882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-386a043d-cc50-429d-8b31-aed5627ab95d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.409292 Jun 06 14:25:14.080738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 201/361] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:13 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:14.148268 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:14.163934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ff990717-d08d-4a9b-bb80-e76a98ca183e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1238 microversion: 2.1 time: 0.183786 Jun 06 14:25:14.166055 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 161/362] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:13 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1238 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:14.293349 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:14.294007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:14.321453 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:14.322220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:14.328549 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:14.329014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:14.438671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:14.439535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:14.468402 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:14.469869 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:14.471911 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:14.473940 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:14.480809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:14.495497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e138fbce-37fb-48b5-bd71-082a58822932 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1218 microversion: 2.1 time: 0.206394 Jun 06 14:25:14.499957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 202/363] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:14 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:14.717437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:14.733800 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9cc8450c-5a83-49c2-8a6d-c35d75c6cb41 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1715 microversion: 2.1 time: 0.299113 Jun 06 14:25:14.735707 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 162/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:14 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1715 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:14.996661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:14.997475 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:15.009782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.010391 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.012552 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.013119 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.114476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:15.116080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:15.128736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.134849 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.136245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.137017 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.627342 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:15.642947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d4c3d618-2303-43e0-85fa-32187d17e963 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1510 microversion: 2.1 time: 0.650677 Jun 06 14:25:15.647781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 203/365] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:14 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:15.657287 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:15.661468 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:15.690551 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.692364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.698969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.701874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.732308 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:15.782125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:15.784911 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:15.787214 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-38e2c72a-2874-464c-bd83-6fe0f306f720 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.677012 Jun 06 14:25:15.787841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 163/366] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:15 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:15.804633 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:15.805301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:15.829468 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.829955 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.830748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:15.836826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:15.851149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:15.872916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4c564868-b898-4eed-aab2-bce12dbe901b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1294 microversion: 2.1 time: 0.223289 Jun 06 14:25:15.874036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 204/367] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:15 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1294 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:15.921465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:15.932991 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e875873e-24b6-4ba8-a1c8-e1cafa7edd70 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1210 microversion: 2.1 time: 0.132347 Jun 06 14:25:15.933679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 164/368] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:15 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:16.669118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:16.670216 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:16.689369 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:16.689968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:16.690925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:16.694948 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:16.807260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:16.808127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:16.818719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:16.818719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:16.819209 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:16.819806 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:17.026742 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:17.036586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-97e0907a-d65c-4c55-8c03-f44b09914610 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1510 microversion: 2.1 time: 0.378842 Jun 06 14:25:17.048714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 205/369] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:16 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:17.076704 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:17.079328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:17.091923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:17.095175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:17.096543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:17.101865 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:17.131987 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:17.147779 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:17.150312 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:17.154163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ecdcf643-2c34-4083-b6d9-7408702b63e9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.350756 Jun 06 14:25:17.156624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 165/370] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:16 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:17.177232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:17.185879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:17.198170 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:17.200585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:17.204395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:17.207369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:17.310571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:17.324427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a3dc2a1a-7242-4801-823e-5513b3bbf68a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1302 microversion: 2.1 time: 0.274632 Jun 06 14:25:17.326194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 206/371] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:17 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1302 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:17.398671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:17.421620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9f0c6cc0-3349-412a-b2c1-251531d1f783 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1266 microversion: 2.1 time: 0.249533 Jun 06 14:25:17.422248 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 166/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:17 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:18.058910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:18.060019 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:18.079366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.080824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.083276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.085431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.189170 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:18.191681 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:18.203831 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.204663 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.206838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.208090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.250076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:18.672277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:18.679822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:18.699922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f4971ca2-14e6-4301-8376-d08093c1d243 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1510 microversion: 2.1 time: 0.646834 Jun 06 14:25:18.700545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:18.704161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:18.705506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 207/373] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:18 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1510 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:18.708237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-699dc3c8-b8ec-45a1-a6cb-e30659c843f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.534670 Jun 06 14:25:18.711616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 167/374] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:18 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:18.720249 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:18.726250 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:18.741157 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.742836 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.743506 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:18.744836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:18.745209 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.745929 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.762801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.763699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.765869 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:18.767579 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:18.899052 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:18.923883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ce89a828-8de8-4cc5-8d1b-c0ca8cf1aa46 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1302 microversion: 2.1 time: 0.215529 Jun 06 14:25:18.938871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 208/375] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:18 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1302 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:18.947725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:18.956710 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6bab898d-b843-4a6d-aa9b-67506b1e5d03 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1266 microversion: 2.1 time: 0.241507 Jun 06 14:25:18.958127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 168/376] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:18 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:19.738611 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:19.741218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:19.748653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:19.753223 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:19.756647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:19.761310 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:19.771927 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:19.773600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:19.781487 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:19.782155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:19.783173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:19.783821 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:20.138428 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:20.157203 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:20.158788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:20.166169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8f651dfa-c00b-4d75-adf9-6792461b6416 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.421643 Jun 06 14:25:20.167146 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 169/377] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:19 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:20.173115 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:20.174715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:20.181826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:20.182678 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:20.183738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:20.184398 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:20.228054 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:20.247692 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-16bfc793-0625-409e-abbc-1038ee54c797 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1510 microversion: 2.1 time: 0.526832 Jun 06 14:25:20.269055 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 209/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:19 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1510 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:20.327699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:20.328705 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:20.359554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:20.369958 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-08b85531-c7bb-45ff-9128-50869ff30b10 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1302 microversion: 2.1 time: 0.201427 Jun 06 14:25:20.370957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:20.371625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 170/379] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:20 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1302 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:20.377935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:20.380251 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:20.381119 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:20.561529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:20.566826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:20.579723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7ae60612-5ca9-41e7-91d9-a04a266f9da5 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1266 microversion: 2.1 time: 0.308892 Jun 06 14:25:20.598482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 210/380] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:20 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:21.197641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:21.198989 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:21.208875 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:21.211644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.217682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.218949 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.219637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.265405 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:21.266201 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:21.279954 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.281337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.287421 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.288213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.448472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:21.484560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:21.487408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:21.491486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5ced6103-7732-48f8-a859-137756d9af50 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.297627 Jun 06 14:25:21.492899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 171/381] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:21 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:21.512685 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:21.513547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:21.530234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.531936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.533745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.535102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.647534 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:21.678630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-98298244-beca-47de-9940-e62d7680c392 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1516 microversion: 2.1 time: 0.413603 Jun 06 14:25:21.683443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 211/382] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:21 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1516 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:21.686047 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:21.701131 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c3a269b7-5fe0-4df5-a1a7-dd37ef90cc4c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1312 microversion: 2.1 time: 0.206635 Jun 06 14:25:21.722398 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 172/383] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:21 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:21.723011 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:21.725389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:21.738558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.739914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.741748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:21.744850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:21.884742 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:21.896659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-13035de9-87a4-4563-8e29-68326766c698 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1266 microversion: 2.1 time: 0.208764 Jun 06 14:25:21.909181 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 212/384] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:21 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:22.514021 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:22.514924 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:22.521909 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:22.522366 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:22.523159 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:22.523599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:22.724653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:22.727206 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=8 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:22.736179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:22.737321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:22.752809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:22.754613 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:22.756548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:22.757448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:22.880910 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:22.901277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:22.905060 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:22.905332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:22.907878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fe3fc2ca-0bf5-4114-b382-9d580a9444f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.398746 Jun 06 14:25:22.909375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 173/385] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:22 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:22.928856 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-34dae41c-64da-43d8-9c05-7869fdd1bdf4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1312 microversion: 2.1 time: 0.207369 Jun 06 14:25:22.932547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:22.935766 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:22.939396 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 213/386] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:22 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:22.946445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:22.946901 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:22.947701 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:22.948156 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:23.026563 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:23.042778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-74a02e39-6e08-4308-88cd-ce8ca4b5743b tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1266 microversion: 2.1 time: 0.123519 Jun 06 14:25:23.043671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 174/387] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:22 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:23.929266 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:23.930255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:23.937468 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:23.938140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:23.939140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:23.939587 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:23.960742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:23.963134 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:23.976758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=12 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:23.997748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:23.998459 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:23.999369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:23.999881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:24.102769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:24.124548 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f1b107dc-91bf-463c-83f7-f8bf18553a9d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1300 microversion: 2.1 time: 0.180254 Jun 06 14:25:24.125059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 175/388] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:23 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1300 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:24.145387 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:24.146057 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:24.158759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:24.164022 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:24.165072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:24.165535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:24.201622 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:24.223704 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:24.227922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:24.231248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4346d91d-61a5-4e64-ae39-2924d0cc7dca tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1740 microversion: 2.20 time: 0.306157 Jun 06 14:25:24.233775 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 214/389] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:23 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:24.281780 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:24.290523 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-af312784-5742-4f0b-b5d8-e55b13d141f8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1274 microversion: 2.1 time: 0.164284 Jun 06 14:25:24.291478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 176/390] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:24 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:24.491548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-daa8cae1-aaed-4c9d-9caa-5bd78758cc4c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'create', calling method: .version_select at 0x7fae8a74d790>, body: {"keypair": {"name": "tempest-keypair-889697557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIArzteNT07DlW9SPRZC7iJ466oXDO+3ambAJGTDaVbAVPcwOgfzBBMqAnxN9YwzOL1/eLlikiW4/OT3YfLRyp2Ycx2S1qv51mIlwsCJLWfFI9/ZJW8LzD5//+ZnHcG1mQ=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:24.506471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-daa8cae1-aaed-4c9d-9caa-5bd78758cc4c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:25:24.510849 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-daa8cae1-aaed-4c9d-9caa-5bd78758cc4c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for user 86f9bcac527c45d6bc81b70e26544924 and project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:25:24.539099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-daa8cae1-aaed-4c9d-9caa-5bd78758cc4c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051408 Jun 06 14:25:24.540288 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 215/391] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:25:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:25.142617 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:25.144713 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:25.153618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:25.154692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:25.156235 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:25.156930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:25.252505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:25.255280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:25.277100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:25.280946 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:25.283501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:25.288105 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:25.288749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:25.295527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a2a1ddd9-0e99-40b9-9816-744fed52556b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1300 microversion: 2.1 time: 0.156317 Jun 06 14:25:25.297254 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 177/392] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:25 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:25.314499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:25.316370 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:25.325808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:25.327123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:25.328226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:25.329293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:25.529866 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:25.540717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-638a4e4b-cbbf-4cef-bd67-91586d89f996 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1272 microversion: 2.1 time: 0.234497 Jun 06 14:25:25.555609 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 178/393] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:25 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:25.603001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:25.614560 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:25.616790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:25.618057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a710eb9c-ea75-4421-9526-0f0703200c07 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1722 microversion: 2.20 time: 0.371637 Jun 06 14:25:25.619132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 216/394] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:25 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:26.335061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:26.336310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:26.363460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:26.364803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:26.366885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:26.368283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:26.569289 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:26.572764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:26.594189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:26.597342 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:26.600215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:26.601051 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:26.916451 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:26.941303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-adb39fc1-96fb-46b4-9d80-aa7b1ab07dae tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.616816 Jun 06 14:25:26.948870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 179/395] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:26 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:26.954333 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:26.954956 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:26.963321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:26.963778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:26.964820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:26.965493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:27.020809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:27.031484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-02b6a0e2-b7df-41f9-b371-5d9e2a451962 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.473665 Jun 06 14:25:27.032087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 217/396] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:26 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:27.254909 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:27.264852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:27.266850 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:27.268081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a43bd237-6d12-4ade-8854-1685fd281ad3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1722 microversion: 2.20 time: 0.317712 Jun 06 14:25:27.269225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 180/397] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:26 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:27.775835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1572419431", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da05c785-91e1-4374-8904-6d56e0757608"}], "security_groups": [{"name": "tempest-securitygroup--953438479"}], "key_name": "tempest-keypair-889697557", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:27.892000 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] validate_networks() for [('da05c785-91e1-4374-8904-6d56e0757608', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:25:27.969358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:27.971715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:27.993302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:27.995497 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:27.997194 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:27.998274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:28.432213 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:28.443207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8ee63ae6-0ef3-4af3-9975-b3775517a10e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.479992 Jun 06 14:25:28.447687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 181/398] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:27 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:28.453593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:28.460467 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:28.489743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:28.490760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:28.491753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:28.492197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:28.896250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:28.913741 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c3606e62-21ec-4a77-9dbf-c7bb5c5af601 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.461702 Jun 06 14:25:28.914657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 182/399] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:28 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:28.937234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:28.938567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:28.953565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:28.953565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:28.954899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:28.955407 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.013601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:25:29.014441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:25:29.018301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:25:29.019074 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:25:29.020845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:25:29.058564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.059710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.061531 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.067070 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.135247 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:25:29.147933 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Getting quotas for user 86f9bcac527c45d6bc81b70e26544924 and project 5e2e414f37bf4a89ac18e1836c793b0b. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:25:29.203811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:25:29.215296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:25:29.258465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:29.270647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:29.272335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:29.273615 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-054a133c-2ae8-4ec6-ba10-b478272fd47d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1722 microversion: 2.20 time: 0.357246 Jun 06 14:25:29.277758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 183/400] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:28 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:29.376788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-018f7630-1737-4435-9216-fc96f075ea0f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.604565 Jun 06 14:25:29.384531 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 218/401] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:25:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:25:29.387864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-5063cec7-ec9b-4da9-841d-7df52ad30c9b req-9cefc1f1-ed33-41ad-b182-629ee187b627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:29.398884 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b16ad218-8b9e-4b38-bb8b-79ea436ddb8c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:29.399714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b16ad218-8b9e-4b38-bb8b-79ea436ddb8c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:29.403200 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:29.405796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-5063cec7-ec9b-4da9-841d-7df52ad30c9b req-9cefc1f1-ed33-41ad-b182-629ee187b627 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.406454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-5063cec7-ec9b-4da9-841d-7df52ad30c9b req-9cefc1f1-ed33-41ad-b182-629ee187b627 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.433870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:29.441587 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-5063cec7-ec9b-4da9-841d-7df52ad30c9b req-9cefc1f1-ed33-41ad-b182-629ee187b627 service nova] Creating event network-vif-unplugged:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:25:29.454950 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-5063cec7-ec9b-4da9-841d-7df52ad30c9b req-9cefc1f1-ed33-41ad-b182-629ee187b627 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072472 Jun 06 14:25:29.455924 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 184/402] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:25:29.472605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:29.487719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:29.521773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.522237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.523743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.524418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.541851 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b16ad218-8b9e-4b38-bb8b-79ea436ddb8c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:29.549739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b16ad218-8b9e-4b38-bb8b-79ea436ddb8c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1245 microversion: 2.1 time: 0.163847 Jun 06 14:25:29.560321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 219/403] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:29 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1245 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:29.779381 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-b44cbeab-a7b0-4eb6-b5f0-b393f4256829 req-1c8c990c-531f-4287-bc00-911a3ebcfbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a7b1c1-18c9-431e-839a-25a63bc33fe9", "tag": "228a9f37-892f-4ca1-b8b8-148e5cd63752"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:29.792205 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:29.796275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b44cbeab-a7b0-4eb6-b5f0-b393f4256829 req-1c8c990c-531f-4287-bc00-911a3ebcfbf8 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.800697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-42bef718-9208-486e-8461-a241f6870b7a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.333321 Jun 06 14:25:29.801237 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b44cbeab-a7b0-4eb6-b5f0-b393f4256829 req-1c8c990c-531f-4287-bc00-911a3ebcfbf8 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.811372 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 185/404] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:29 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:29.839017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-b44cbeab-a7b0-4eb6-b5f0-b393f4256829 req-1c8c990c-531f-4287-bc00-911a3ebcfbf8 service nova] Creating event network-changed:228a9f37-892f-4ca1-b8b8-148e5cd63752 for instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 on hv-cinder-84414 Jun 06 14:25:29.857341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-b44cbeab-a7b0-4eb6-b5f0-b393f4256829 req-1c8c990c-531f-4287-bc00-911a3ebcfbf8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081833 Jun 06 14:25:29.859067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 220/405] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:29.944579 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:29.944884 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:29.956096 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.956867 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:29.963796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:29.964743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:30.188493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:30.200789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-39589a71-81dd-433b-b81e-3719564429de tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.265213 Jun 06 14:25:30.201810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 186/406] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:29 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:30.305175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:30.305923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:30.312761 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:30.313223 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:30.314063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:30.314505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:30.475177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:30.484969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:30.486942 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:30.488732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e5fb9758-227f-4e6c-b7de-dced9befb4ee tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1722 microversion: 2.20 time: 0.188598 Jun 06 14:25:30.489349 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 221/407] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:30 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:30.577808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:30.578853 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:30.594275 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:30.595010 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:30.596341 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:30.597080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:30.694159 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:30.709256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-79b56bc9-4007-4898-b68a-41ccad9b9d0e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1249 microversion: 2.1 time: 0.143960 Jun 06 14:25:30.710345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 187/408] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:30 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1249 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:30.822871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:30.823977 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:30.836314 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:30.837086 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:30.838747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:30.839508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.167686 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:31.196118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-66a5927d-1504-4251-80f8-1e69ffa58fcc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.378759 Jun 06 14:25:31.197438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 222/409] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:30 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:31.236208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:31.239798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:31.256643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.258656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.262233 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.262837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.517091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:31.517336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:31.518875 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:31.525173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.525807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.526011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-91d2bc00-b30f-42b5-959d-9083a02c17e8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.299165 Jun 06 14:25:31.526479 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 188/410] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:31 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:31.526824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.527352 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.691305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:31.706785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:31.710850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:31.714047 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ae755dd0-37a3-4010-a114-617314d5b9a1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1725 microversion: 2.20 time: 0.200410 Jun 06 14:25:31.725833 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 223/411] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:31 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:31.733144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:31.734263 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:31.749447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.751501 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.752603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.754222 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.754996 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e28a322-2022-43f4-9dd1-e9603346a114"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:31.757823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:31.774021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.775330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.777320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.778501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.913569 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:31.925005 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a2f4a28c-dbbf-48b4-b6d2-6d169c8cfe99 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1297 microversion: 2.1 time: 0.197997 Jun 06 14:25:31.926768 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 189/412] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:31 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1297 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:31.931932 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-f2b6f168-87b1-4172-be98-ae29685ad276 req-a514445b-05ff-43d9-a0bd-d6554c399c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df4fe33-1d83-4d2c-ab48-dbdd31902a0f", "tag": "4c84088c-bb71-4e25-a2b8-07695dfe32a8"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:31.950495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f2b6f168-87b1-4172-be98-ae29685ad276 req-a514445b-05ff-43d9-a0bd-d6554c399c85 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:31.951411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f2b6f168-87b1-4172-be98-ae29685ad276 req-a514445b-05ff-43d9-a0bd-d6554c399c85 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:31.991153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-f2b6f168-87b1-4172-be98-ae29685ad276 req-a514445b-05ff-43d9-a0bd-d6554c399c85 service nova] Creating event network-changed:4c84088c-bb71-4e25-a2b8-07695dfe32a8 for instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f on hv-cinder-84414 Jun 06 14:25:32.001192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-f2b6f168-87b1-4172-be98-ae29685ad276 req-a514445b-05ff-43d9-a0bd-d6554c399c85 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072199 Jun 06 14:25:32.002506 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 190/413] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:32.226452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:32.227486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:32.237005 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.237522 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.238551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.239004 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.318070 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-655b9f7d-2c3d-4fb0-a433-46af2c3026c7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.572537 Jun 06 14:25:32.321880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 224/414] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jun 6 14:25:31 2022] POST /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments => generated 188 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:25:32.554874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:32.556194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:32.581338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.582177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.583776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.585034 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.694734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:32.709857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-163a76ea-9079-4f77-9e11-d8c35655b2ba tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.488542 Jun 06 14:25:32.725749 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 191/415] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:32 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:32.733778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:32.736199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:32.749503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.750369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.751827 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.752625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.919640 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:32.933459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ba053f87-0077-42f9-bc0c-ee9c4394c228 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.386097 Jun 06 14:25:32.934091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 225/416] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:32 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:32.950092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6fe68cbf-e4ec-4062-80b2-0ec2178f1a76 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/action" status: 202 len: 0 microversion: 2.20 time: 0.229010 Jun 06 14:25:32.950796 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:32.951232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 192/417] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 14:25:32 2022] POST /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:25:32.951714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:32.963052 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:32.964230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:32.972949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.973360 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.973994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.976022 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.977017 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.977890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:32.983148 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:32.984008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:33.186744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:33.204012 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-79abef0d-8d57-4778-8cf6-15e59a1a003d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1303 microversion: 2.1 time: 0.246070 Jun 06 14:25:33.209937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 193/418] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:32 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:33.226751 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:33.229121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:33.250644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:33.252417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:33.254826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:33.255624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:33.297627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lazy-loading 'services' on Instance uuid 4a09198a-932a-4172-91a9-6d0648e54f85 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:25:33.524688 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f4f8c1c5-d1d0-4357-a4ce-c3ae14183d4d tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85/os-volume_attachments/620581dd-db3a-46a8-82c7-07f447406c7d" status: 202 len: 0 microversion: 2.1 time: 0.589066 Jun 06 14:25:33.525497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 226/419] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:25:32 2022] DELETE /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85/os-volume_attachments/620581dd-db3a-46a8-82c7-07f447406c7d => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:25:33.661583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:33.671111 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:33.676195 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:33.677573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c6f91389-53c5-479e-8df2-cf9300d1f940 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1751 microversion: 2.20 time: 0.464801 Jun 06 14:25:33.678208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 194/420] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:33 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1751 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:33.744492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:33.745324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:33.756085 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:33.756552 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:33.757350 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:33.757845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:33.786972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:33.958366 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:33.960058 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:33.977625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:33.978743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:33.980658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:33.982837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:34.131118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:34.146916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-05d62421-643e-4931-8f85-f0d2043f249c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.407058 Jun 06 14:25:34.159401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 227/421] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:33 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:34.236203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:34.246723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:34.263930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:34.265799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:34.275970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:34.276529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:34.392857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:34.410449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-88435308-596d-461f-a732-4a6939fccffb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.458819 Jun 06 14:25:34.414383 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 195/422] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:33 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:34.539970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:34.552919 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9126be3e-14ad-49a8-921c-f621ed857772 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.323873 Jun 06 14:25:34.561685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 228/423] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:34 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:34.705744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:34.706558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:34.713614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:34.714176 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:34.714959 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:34.715391 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:34.884649 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:34.897606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:34.899393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:34.900801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-224770e4-db52-40fd-8526-fd3d29c01ce0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1751 microversion: 2.20 time: 0.199586 Jun 06 14:25:34.901449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 196/424] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:34 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:35.165746 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:35.166725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:35.175527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:35.176072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:35.176830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:35.177273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:35.372232 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:35.389517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3bb5606d-a636-4e91-a467-73232856755c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.228444 Jun 06 14:25:35.410589 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 229/425] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:35 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:35.436654 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:35.442933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:35.467553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:35.471113 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:35.473197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:35.479245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:35.582294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:35.583246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:35.594515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:35.595299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:35.596424 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:35.596868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:36.117000 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:36.128928 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-81607c3b-5490-4a1a-9ab1-1f35b11241e7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.550243 Jun 06 14:25:36.129766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 230/426] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:35 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:36.137438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:36.138470 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:36.149346 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:36.158060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:36.159284 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:36.161813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:36.164091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:36.167839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6d8fcb0c-bbc3-450b-9410-fd11b05c3540 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.740001 Jun 06 14:25:36.170378 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 197/427] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:35 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:36.421644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:36.422861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:36.438221 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:36.442066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:36.444618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:36.445868 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:36.888038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:36.913793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:36.918176 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:36.920882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7af571de-37cc-4f9c-9584-f340ef69f93a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1753 microversion: 2.20 time: 0.789583 Jun 06 14:25:36.922224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 231/428] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:36 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1753 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:37.036031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:37.036541 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:37.051818 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.052482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.053487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.054126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.098883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:37.122008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a140c235-0948-4cf2-b370-d63eb1f2f17f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.708765 Jun 06 14:25:37.123535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 198/429] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:36 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:37.131983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:25:37.152021 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:37.152702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:37.169488 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.171578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.174094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.175126 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.326722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-74a5ab93-1b7d-4fe9-b77c-0666917c8031 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 204 len: 0 microversion: 2.1 time: 0.294693 Jun 06 14:25:37.327417 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 232/430] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:25:37 2022] DELETE /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:25:37.334488 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:37.338975 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:37.347173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.347509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.348844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.349363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.661078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:37.677761 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-916f37c7-e6c2-42fb-b80d-d461abac13da tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.529072 Jun 06 14:25:37.682591 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 199/431] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:37 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:37.693315 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:37.703729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:37.706778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:37.713509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.713986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.714803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.715245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.716358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b7c51f5d-38dd-456e-918c-dd44cde93d53 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.387197 Jun 06 14:25:37.717391 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 233/432] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:37 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:37.732181 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-171ec038-d86e-496b-ad88-7d74f5ffb8a1 req-5cb35136-fed5-4f51-b419-ffca86ca946a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50386bc4-52ea-44da-834e-381f38cc47c3", "tag": "df54d3c7-86bf-4c37-ba45-0d8672392f1d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:37.749356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-171ec038-d86e-496b-ad88-7d74f5ffb8a1 req-5cb35136-fed5-4f51-b419-ffca86ca946a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.750327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-171ec038-d86e-496b-ad88-7d74f5ffb8a1 req-5cb35136-fed5-4f51-b419-ffca86ca946a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.781747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-171ec038-d86e-496b-ad88-7d74f5ffb8a1 req-5cb35136-fed5-4f51-b419-ffca86ca946a service nova] Creating event network-changed:df54d3c7-86bf-4c37-ba45-0d8672392f1d for instance 50386bc4-52ea-44da-834e-381f38cc47c3 on hv-cinder-84414 Jun 06 14:25:37.793304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-171ec038-d86e-496b-ad88-7d74f5ffb8a1 req-5cb35136-fed5-4f51-b419-ffca86ca946a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068656 Jun 06 14:25:37.794935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 234/433] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:37.835514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-0be34d2f-45c0-43d3-8b63-01679f441dd4 req-b6d71359-7e43-4794-b95d-ea81b16ddd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df4fe33-1d83-4d2c-ab48-dbdd31902a0f", "name": "network-vif-plugged", "status": "completed", "tag": "4c84088c-bb71-4e25-a2b8-07695dfe32a8"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:37.857597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0be34d2f-45c0-43d3-8b63-01679f441dd4 req-b6d71359-7e43-4794-b95d-ea81b16ddd80 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.858204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0be34d2f-45c0-43d3-8b63-01679f441dd4 req-b6d71359-7e43-4794-b95d-ea81b16ddd80 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.880452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-0be34d2f-45c0-43d3-8b63-01679f441dd4 req-b6d71359-7e43-4794-b95d-ea81b16ddd80 service nova] Creating event network-vif-plugged:4c84088c-bb71-4e25-a2b8-07695dfe32a8 for instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f on hv-cinder-84414 Jun 06 14:25:37.888582 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-0be34d2f-45c0-43d3-8b63-01679f441dd4 req-b6d71359-7e43-4794-b95d-ea81b16ddd80 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066444 Jun 06 14:25:37.890056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 235/434] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:37.942759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:37.947102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:37.948688 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:37.960379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-786f60b4-40d6-4fc7-9d1e-e2e7fc14ad97 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1514 microversion: 2.1 time: 0.276249 Jun 06 14:25:37.962067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.962834 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:37.964723 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:37.966234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 200/435] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:37 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:37.974671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.133328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:38.142832 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:38.143980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:38.146766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:38.148996 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:38.150992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.151234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e12ff7fd-f488-4b71-a5cb-55691f55a23f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.213952 Jun 06 14:25:38.151661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.152048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 236/436] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:37 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:38.155181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.155833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.163648 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:38.341003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:38.351002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a00947b8-f706-4642-b184-6ead718b788e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.212167 Jun 06 14:25:38.351710 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 201/437] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:38 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:38.710684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:38.711358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:38.719112 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.719699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.720548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.720983 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.738094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:38.739044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:38.749537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.751013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.752319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.753884 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.939387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:38.950945 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e6d1b9b0-f944-4d06-8bd6-96f5d6eb1467 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.244842 Jun 06 14:25:38.952068 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 237/438] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:38 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:38.982849 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:38.983025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:38.984088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:38.992980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-adab0b64-74ea-4d06-8ebf-9f7f6aa2f22d tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.259994 Jun 06 14:25:38.993499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 202/439] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:38 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:38.995781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.996584 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:38.998071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:38.998862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.104273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:39.163029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:39.172859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:39.173554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:39.173914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a2125880-9c52-48e2-b1e8-ea56e74cf15f tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1514 microversion: 2.1 time: 0.198278 Jun 06 14:25:39.175320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 238/440] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:38 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:39.187533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.188328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.190714 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.192677 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.373508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:39.375457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:39.384521 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.385057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.387525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.387525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.494974 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:39.507117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:39.509474 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:39.514614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8bf0e51c-fbc5-4a44-a5f8-daee83606268 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.345811 Jun 06 14:25:39.516039 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 203/441] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:39 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:39.551627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=12 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:39.609115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:39.630353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0d0f339f-ce3d-49e1-be0b-28a462e1b54a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.264334 Jun 06 14:25:39.634065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 239/442] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:39 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:39.912639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-62ab1827-774d-42af-b807-cca47d249fd9 req-b6560b32-c0ce-47e3-af32-48ab9ae58dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7b1c1-18c9-431e-839a-25a63bc33fe9", "name": "network-vif-plugged", "status": "completed", "tag": "228a9f37-892f-4ca1-b8b8-148e5cd63752"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:39.929441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-62ab1827-774d-42af-b807-cca47d249fd9 req-b6560b32-c0ce-47e3-af32-48ab9ae58dbf service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.930121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-62ab1827-774d-42af-b807-cca47d249fd9 req-b6560b32-c0ce-47e3-af32-48ab9ae58dbf service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.953118 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-62ab1827-774d-42af-b807-cca47d249fd9 req-b6560b32-c0ce-47e3-af32-48ab9ae58dbf service nova] Creating event network-vif-plugged:228a9f37-892f-4ca1-b8b8-148e5cd63752 for instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 on hv-cinder-84414 Jun 06 14:25:39.960590 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-62ab1827-774d-42af-b807-cca47d249fd9 req-b6560b32-c0ce-47e3-af32-48ab9ae58dbf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054911 Jun 06 14:25:39.961969 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 204/443] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:39.976807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:39.976807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:39.992632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.993729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:39.996950 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:39.998019 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:40.011198 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:40.011907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:40.033177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:40.033633 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:40.035478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:40.038403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:40.678721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:40.710259 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0aabc6c0-32d1-4442-a204-f82f04147ca9 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.703658 Jun 06 14:25:40.711463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 205/444] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:40 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:40.722616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:40.724394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:40.728343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:40.740241 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:40.742020 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:40.743937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:40.745085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:40.753824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:40.777788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3feb8696-f32b-42a9-97b2-91f7d385d97d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.809742 Jun 06 14:25:40.778763 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 240/445] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:39 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:40.786774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:40.788266 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:40.800297 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:40.800994 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:40.802417 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:40.803209 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.035147 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:41.050790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9dc75e68-f670-4420-ac28-182d6de4d081 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1514 microversion: 2.1 time: 0.337140 Jun 06 14:25:41.051496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:41.068744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:41.068744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:41.070243 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3c244606-10dc-4d15-ad24-e72a12bad183 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.289702 Jun 06 14:25:41.070539 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 206/446] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:40 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1514 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:41.071282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 241/447] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:40 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:41.082193 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:41.083741 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:41.113759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.114550 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.116009 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.116788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.224805 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-db67b056-170b-470b-9516-e3932711c19e req-c12d56f5-cf5a-4379-83aa-68f1978af756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a09198a-932a-4172-91a9-6d0648e54f85", "name": "network-vif-deleted", "tag": "46d8ff0b-6f53-4752-a775-f06a8d92aebb"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:41.234426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-db67b056-170b-470b-9516-e3932711c19e req-c12d56f5-cf5a-4379-83aa-68f1978af756 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.234883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-db67b056-170b-470b-9516-e3932711c19e req-c12d56f5-cf5a-4379-83aa-68f1978af756 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.248632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-db67b056-170b-470b-9516-e3932711c19e req-c12d56f5-cf5a-4379-83aa-68f1978af756 service nova] Creating event network-vif-deleted:46d8ff0b-6f53-4752-a775-f06a8d92aebb for instance 4a09198a-932a-4172-91a9-6d0648e54f85 on hv-cinder-84414 Jun 06 14:25:41.254509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-db67b056-170b-470b-9516-e3932711c19e req-c12d56f5-cf5a-4379-83aa-68f1978af756 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034203 Jun 06 14:25:41.255240 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 242/448] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:25:41.345892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:41.355125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cb8d2798-443e-4a59-b275-c001e6d78b28 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1368 microversion: 2.1 time: 0.282344 Jun 06 14:25:41.355737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 207/449] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:41 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:41.742198 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:41.743576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:41.753567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.754142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.755015 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.755555 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.805881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:41.806847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:41.822860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.823810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:41.825083 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:41.825915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.006127 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.016054 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-14fc0ca4-9474-47f7-be35-5908bce22cde tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1314 microversion: 2.1 time: 0.282399 Jun 06 14:25:42.016963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 243/450] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:41 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:42.046971 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.064224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-38687fe9-b2c0-4c44-9ea4-6d12fdcb7dde tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.265151 Jun 06 14:25:42.065369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 208/451] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:41 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:42.077259 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:42.077943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:42.084889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.085350 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.086230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.086702 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.104345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:42.105911 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:42.112883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:42.117785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.118557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.119900 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.120632 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.193236 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.212517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cd55b0c5-0eca-46d5-8937-2cdc53f7d78c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1304 microversion: 2.1 time: 0.138921 Jun 06 14:25:42.214785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 244/452] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:42 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:42.374224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.383318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:42.384700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:42.393682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.397265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.399656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-00fb1661-90b9-475c-a2a0-a411039a16f7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.303032 Jun 06 14:25:42.400822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 209/453] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:42 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:42.402529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.403815 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.405680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.406667 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.579432 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:42.589520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5448932c-6e77-4f56-bba7-0b37ef1b646e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1559 microversion: 2.1 time: 0.216920 Jun 06 14:25:42.590214 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 245/454] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:42 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:42.607432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:42.607979 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:42.616829 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.617234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.618175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:42.618671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:42.711247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5fc84cc6-7e94-4c3d-bc11-139418b00cf0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107679 Jun 06 14:25:42.712347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 210/455] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:25:42 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:43.043895 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:43.045015 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:43.055270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.056100 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.057192 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.057881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.084459 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:43.086528 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:43.099475 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.103558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.105043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.108711 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.428625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:43.444813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c47df1d7-019d-49c2-8197-e0d092838598 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1498 microversion: 2.1 time: 0.404621 Jun 06 14:25:43.452408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:43.465377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 246/456] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:43 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1498 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:43.470687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6b7b1bd9-59c9-401f-bef4-f211b07fbd82 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.390468 Jun 06 14:25:43.472210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:43.473578 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:43.481514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.482321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.483331 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.484084 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.491390 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 211/457] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:43 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:43.498795 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:43.499848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:43.520704 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.521592 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.523316 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.524099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.527285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:43.527926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:43.528385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lazy-loading 'fault' on Instance uuid 4a09198a-932a-4172-91a9-6d0648e54f85 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:25:43.583631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:43.595017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f4d34a9b-b197-443e-9a86-b9a25ecb734b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 200 len: 1309 microversion: 2.1 time: 0.127857 Jun 06 14:25:43.601850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 247/458] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:43 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:43.747624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:43.761733 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:43.763566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:43.765159 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bdab3241-8284-4cdd-a488-c2271c77ab68 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.272187 Jun 06 14:25:43.765460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 212/459] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:43 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:44.203741 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:44.204656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:44.219319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.220739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.223383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.224636 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.274872 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:25:44.391952 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-c46b1bf5-5743-406c-a0ae-662a6f9a4bf7 req-e56c3dc0-466a-4359-8a6e-3357852e1708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df4fe33-1d83-4d2c-ab48-dbdd31902a0f", "tag": "4c84088c-bb71-4e25-a2b8-07695dfe32a8"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:44.420091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-c46b1bf5-5743-406c-a0ae-662a6f9a4bf7 req-e56c3dc0-466a-4359-8a6e-3357852e1708 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.423789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-c46b1bf5-5743-406c-a0ae-662a6f9a4bf7 req-e56c3dc0-466a-4359-8a6e-3357852e1708 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.456703 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-c46b1bf5-5743-406c-a0ae-662a6f9a4bf7 req-e56c3dc0-466a-4359-8a6e-3357852e1708 service nova] Creating event network-changed:4c84088c-bb71-4e25-a2b8-07695dfe32a8 for instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f on hv-cinder-84414 Jun 06 14:25:44.474900 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-c46b1bf5-5743-406c-a0ae-662a6f9a4bf7 req-e56c3dc0-466a-4359-8a6e-3357852e1708 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093132 Jun 06 14:25:44.477096 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 213/460] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:44.486016 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-089a69a6-b3eb-477f-9420-b61a4a9c48bb tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 204 len: 0 microversion: 2.1 time: 0.290135 Jun 06 14:25:44.497482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 248/461] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:25:44 2022] DELETE /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:25:44.523006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:44.524294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:44.526383 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:44.528212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:44.540811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.542116 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.543696 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.544560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.545072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.546318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.547237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.548328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.807828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:44.821516 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:44.826298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e6e3983c-0979-4194-b340-b23fd9ef4f52 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.329004 Jun 06 14:25:44.827220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 214/462] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:44 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:44.832210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:44.833540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 4a09198a-932a-4172-91a9-6d0648e54f85] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:44.833694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9e1f9d37-c883-48d5-8cd4-4332ad3adaba tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.332826 Jun 06 14:25:44.835590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 249/463] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:44 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:44.846346 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:44.847749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:44.852140 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.852689 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.853552 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.854487 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.859099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.860208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.862316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:44.862995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:44.871625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] HTTP exception thrown: Instance 4a09198a-932a-4172-91a9-6d0648e54f85 could not be found. Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Request method failure captured: Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 HTTP/1.1 Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing4JQqaLfrLMzYmL2GICuupODySobb2dO9rvqrRo_sVHwiwbQkeCfE2LNXpTx3m-AcOOIoSD66jMKzlNNy8J0MZgWf-H-WdwtP1bw2jQteUzGQGB9Wu3T2uNYSbR2rvZfUS2hpJz8fVchk8tNfyhR89WDKzTi40eyQ-XUakB19Bu7hc Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 810c087aef3d453cb9c0365467dd9134 Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1634713131 Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:25:44.874099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/810c087aef3d453cb9c0365467dd9134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/810c087aef3d453cb9c0365467dd9134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_810c087aef3d453cb9c0365467dd9134", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/810c087aef3d453cb9c0365467dd9134"}]}] Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotTestJSON-1634713131 Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 810c087aef3d453cb9c0365467dd9134 Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1634713131 Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotTestJSON-1634713131-project Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 66ded9372b644c57a9f13fc88ff7fdb6 Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotTestJSON-1634713131-project Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 4a09198a-932a-4172-91a9-6d0648e54f85 could not be found. Jun 06 14:25:44.876928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '4a09198a-932a-4172-91a9-6d0648e54f85'} Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a09198a-932a-4172-91a9-6d0648e54f85 could not be found. Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:25:44.880393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a09198a-932a-4172-91a9-6d0648e54f85 could not be found. Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a09198a-932a-4172-91a9-6d0648e54f85 could not be found. Jun 06 14:25:44.883119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:25:44.885527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Returning 404 to user: Instance 4a09198a-932a-4172-91a9-6d0648e54f85 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:25:44.885527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8b90e484-2b85-41f8-9932-ca38e8c1fbc0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85" status: 404 len: 111 microversion: 2.1 time: 0.048475 Jun 06 14:25:44.885527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 215/464] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:44 2022] GET /compute/v2.1/servers/4a09198a-932a-4172-91a9-6d0648e54f85 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:25:45.108018 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:45.126306 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:45.130172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:45.132494 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3b3a23bc-6fdf-4cf4-b42d-31986d7a45ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.294861 Jun 06 14:25:45.133527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 250/465] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:44 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:45.854020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:45.855825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:45.859438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:45.860545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:45.864561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:45.865021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:45.865866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:45.866315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:45.873145 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:45.874182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:45.875937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:45.877219 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:46.114676 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:46.123468 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8d48d613-b8f5-4b3f-892f-9fced08041a4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.273774 Jun 06 14:25:46.124294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 251/466] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:45 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:46.127988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:46.136663 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-845defbc-6978-424d-8be7-6177b6c4f406 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.287820 Jun 06 14:25:46.137317 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 216/467] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:45 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:46.161441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:46.162098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:46.169389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:46.169957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:46.170786 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:46.171230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:46.327205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:46.337448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:46.339052 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:46.340283 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7d772e9a-881a-4c62-925f-5c4b8524c841 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.183492 Jun 06 14:25:46.340862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 252/468] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:46 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:47.147217 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:47.147809 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:47.155073 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:47.155519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:47.156307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:47.156743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:47.158643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:47.159817 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:47.171991 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:47.172799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:47.174328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:47.175149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:47.376410 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:47.387303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-00088cbd-2817-4fcd-8808-acf3200e1c34 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.244897 Jun 06 14:25:47.387910 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 217/469] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:47 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:47.394473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:47.395266 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:47.402081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:47.402383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:47.402573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:47.403299 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:47.403734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:47.411853 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fe076812-6056-468f-ba70-008c94e8f544 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.259710 Jun 06 14:25:47.412662 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 253/470] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:47 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:47.558002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:47.567613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:47.569177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:47.570497 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a20ae4c7-1a6f-46d8-bbb0-5ae8e1ddc6b6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.181601 Jun 06 14:25:47.571125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 218/471] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:47 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:48.408474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:48.409090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:48.417024 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:48.417608 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:48.418452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:48.418892 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:48.434685 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:48.435696 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:48.446689 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:48.447289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:48.448293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:48.448830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:48.745910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:48.767555 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3020cdac-a0fb-409e-aa6c-ecfcf8f834ad tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.361850 Jun 06 14:25:48.782576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 254/472] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:48 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:48.782576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:48.783046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:48.791429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:48.791901 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:48.792714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:48.793157 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:48.805931 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:48.820570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a665f397-f16e-4b61-aecc-c457427261d1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.390269 Jun 06 14:25:48.821619 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 219/473] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:48 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:49.012689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:49.030857 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:49.035770 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:49.038095 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1cb31bf6-2af8-4ddd-bddf-bdf49c4c7f69 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.261836 Jun 06 14:25:49.053801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 255/474] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:48 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:49.796510 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:49.797194 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:49.808297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:49.808883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:49.810164 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:49.810887 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:49.819135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:49.840809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:49.842403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:49.851353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:49.851890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:49.853170 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:49.853485 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:50.291766 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:50.328187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b8fa2b15-87e9-4ee9-bc7b-089bb976a4f2 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.535451 Jun 06 14:25:50.343648 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 220/475] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:49 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:50.367030 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:50.368879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:50.409424 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:50.410552 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:50.413265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:50.414267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:50.420668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:50.445931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-70ff8460-8b44-4575-b40c-7b8120623cc4 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.609882 Jun 06 14:25:50.447999 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 256/476] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:49 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:50.740390 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:50.780723 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:50.787423 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:50.790338 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1e8d5194-f66a-4e0a-8b6a-f74ded8ceaef tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.443956 Jun 06 14:25:50.792108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 221/477] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:50 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:51.382129 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:51.384968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:51.399673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:51.401094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:51.402837 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:51.404037 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:51.485898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:51.493196 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:51.528637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:51.530223 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:51.534969 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:51.535708 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:51.812961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:51.834467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d6b082df-b979-496c-aeef-2dbc5772afdc tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.467069 Jun 06 14:25:51.836607 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 257/478] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:51 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:51.863102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:51.871075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:51.887644 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:51.888127 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:51.888934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:51.889383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:51.908820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:51.927877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ca2c916c-2ea3-4b7a-bea8-c38dfd5f179c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.450448 Jun 06 14:25:51.929475 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 222/479] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:51 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:52.157057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:52.170039 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:52.171798 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:52.173017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2e6ac559-a563-49af-a954-421609ac8562 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.334530 Jun 06 14:25:52.173565 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 258/480] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:51 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:52.864355 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:52.865271 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:52.873753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:52.874232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:52.875316 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:52.875759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:52.949473 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:52.950602 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:52.972958 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:52.977773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:52.980047 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:52.980815 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:52.996302 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:53.163104 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:53.193951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fc6b954b-7b09-4484-9524-c605cd51eb25 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.321754 Jun 06 14:25:53.210518 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 223/481] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:52 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:53.237943 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:53.241736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:53.262789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:53.274629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:53.276307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:53.277377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:53.524806 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:53.534425 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e73b24fb-3aa5-4cc1-b056-682a350eb953 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.591486 Jun 06 14:25:53.537879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 259/482] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:52 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:53.614923 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:53.631377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:53.633342 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:53.635273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d6adc73f-3d6c-4f6b-9c05-4c71bddcfe29 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.422591 Jun 06 14:25:53.636242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 224/483] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:53 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:54.228902 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:54.230141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:54.240751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:54.241911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:54.243863 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:54.244511 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:54.498769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:54.513079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2b999530-8140-4cbf-9f4a-e741d1761b49 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.288546 Jun 06 14:25:54.518655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 260/484] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:54 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:54.557795 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:54.558839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:54.570867 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:54.572229 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:54.573939 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:54.574702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:54.664959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:54.666430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:54.677754 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:25:54.681143 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:54.681937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:54.683394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:54.685195 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:54.812877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:54.824196 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-570191fc-6c92-4dcf-8cda-a061e14e53b1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.275245 Jun 06 14:25:54.833394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 225/485] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:54 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:54.929316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:54.946712 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:54.949370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:54.951920 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-75835165-df90-4784-b3bf-d647c72e5410 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.294746 Jun 06 14:25:54.953269 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 261/486] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:54 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:55.538612 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:55.539235 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:55.548348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:55.548885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:55.550147 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:55.550585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:55.648712 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1467551500", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "networks": [{"uuid": "ba8a6d51-0856-4b11-b612-e03ba6d3288e"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:55.779856 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] validate_networks() for [('ba8a6d51-0856-4b11-b612-e03ba6d3288e', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:25:55.946384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:55.954424 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-21ab259a-476f-4432-999f-cc7cc3edb0f1 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.420816 Jun 06 14:25:55.957931 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 226/487] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:55 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:55.961387 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:55.962081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:55.968624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:55.969075 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:55.969913 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:55.970357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:56.296616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:56.310457 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fd87bc1d-d3ae-4060-be9a-7bb7f49deb01 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.352468 Jun 06 14:25:56.322449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 227/488] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:55 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:56.338448 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:56.339907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:56.351825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:56.353055 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:56.354965 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:56.355841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:56.615221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:25:56.615960 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:56.616664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:25:56.617928 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:25:56.619959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:25:56.621405 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:25:56.628469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:56.628469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:56.629453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-934e79e5-9d2f-4260-9fc9-c321ee978645 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.305167 Jun 06 14:25:56.630093 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 228/489] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:56 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:56.651144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:56.652049 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:56.652729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:56.653274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:56.685097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Getting quotas for project 810c087aef3d453cb9c0365467dd9134. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:25:56.690340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Getting quotas for user 66ded9372b644c57a9f13fc88ff7fdb6 and project 810c087aef3d453cb9c0365467dd9134. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:25:56.710519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:25:56.712720 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:25:56.785370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-31616b44-7319-46f8-bfa8-948d4eddfa50 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149671 Jun 06 14:25:56.789583 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 262/490] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:25:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:25:56.801079 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-965c8e89-abc7-44f6-8806-cd14d9f6deef tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:56.801728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-965c8e89-abc7-44f6-8806-cd14d9f6deef tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:56.921632 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-965c8e89-abc7-44f6-8806-cd14d9f6deef tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:56.935495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-965c8e89-abc7-44f6-8806-cd14d9f6deef tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1219 microversion: 2.1 time: 0.138441 Jun 06 14:25:56.945829 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 229/491] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:56 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:56.976347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:56.977147 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:56.987517 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:56.988492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:56.989597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:56.990246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:57.301893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:57.322348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2f12c28a-fd89-464f-ad29-f46002fcc590 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.348946 Jun 06 14:25:57.323352 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 263/492] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:56 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:25:57.344607 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:57.345236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:57.369410 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:57.369875 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:57.370668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:57.376735 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:57.648749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:57.649533 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:57.656593 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:57.662218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:57.663169 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:57.663710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:57.706275 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:57.716435 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-63f2bc89-99a3-4597-809b-766e9c2b5409 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.377049 Jun 06 14:25:57.729193 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 230/493] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:57 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:57.897994 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:57.909120 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:57.911726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:57.913501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d9c6220c-85c1-42ed-9a93-3503501a138a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.268441 Jun 06 14:25:57.926414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 264/494] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:57 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:25:57.961261 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:57.962679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:57.984668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:57.985496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:57.987507 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:57.988164 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:58.073429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:58.086269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c3d31d30-9361-450b-8f25-8b4faff30da9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1223 microversion: 2.1 time: 0.128877 Jun 06 14:25:58.087269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 231/495] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:57 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:58.342521 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:58.343386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:58.351308 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:58.352052 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:58.353003 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:58.353550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:58.586072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:58.601121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6e1589a9-ff6d-44a4-953a-43eab6bbb4a8 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.263144 Jun 06 14:25:58.605806 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 265/496] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:58 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:58.755542 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:58.756691 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:58.764549 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:58.765001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:58.765837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:58.766281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:58.936685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:58.938454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:58.965018 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:58.968960 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:58.975661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:58.977127 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:59.097402 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:59.113950 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b8331047-84a6-411f-9466-3286d36648b7 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.365745 Jun 06 14:25:59.118547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 232/497] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:58 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:59.128401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:59.131774 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:59.160832 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:59.161605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:59.163289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:59.171322 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:59.363442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:59.385464 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:59.386918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:59.389415 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:59.391164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cf66257b-9940-4df5-9852-a10dc60dd1c6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.461379 Jun 06 14:25:59.392177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 266/498] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:25:58 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:25:59.404961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7484fd76-bddf-4729-b489-7337d767f27c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1223 microversion: 2.1 time: 0.284537 Jun 06 14:25:59.407165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 233/499] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:59 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1223 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:25:59.441364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-01c9be9f-229b-4353-b5bf-62ccf0c71680 req-f8f514de-fb4b-47b6-939a-05362833b808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50386bc4-52ea-44da-834e-381f38cc47c3", "name": "network-vif-plugged", "status": "completed", "tag": "df54d3c7-86bf-4c37-ba45-0d8672392f1d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:25:59.457273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-01c9be9f-229b-4353-b5bf-62ccf0c71680 req-f8f514de-fb4b-47b6-939a-05362833b808 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:59.459038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-01c9be9f-229b-4353-b5bf-62ccf0c71680 req-f8f514de-fb4b-47b6-939a-05362833b808 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:59.480066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-01c9be9f-229b-4353-b5bf-62ccf0c71680 req-f8f514de-fb4b-47b6-939a-05362833b808 service nova] Creating event network-vif-plugged:df54d3c7-86bf-4c37-ba45-0d8672392f1d for instance 50386bc4-52ea-44da-834e-381f38cc47c3 on hv-cinder-84414 Jun 06 14:25:59.491600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-01c9be9f-229b-4353-b5bf-62ccf0c71680 req-f8f514de-fb4b-47b6-939a-05362833b808 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054544 Jun 06 14:25:59.492746 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 267/500] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:25:59.628965 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:25:59.630203 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:25:59.641226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:59.642029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:59.643309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:25:59.644088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:25:59.818717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:25:59.832188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a4cfcb43-72a9-42f1-9996-d2c26cf8a578 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.208519 Jun 06 14:25:59.837505 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 234/501] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:25:59 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:00.144075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:00.144834 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:00.153149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.153824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.154618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.155067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.331225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:00.339224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-745cebbb-98aa-41ab-a1cb-9476c6865fe5 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.200969 Jun 06 14:26:00.339819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 268/502] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:00 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:00.425127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:00.426062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:00.427909 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:00.428914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:00.436544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.437310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.438628 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.439150 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.439822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.440656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.441979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.442717 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.591774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:00.615898 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bcde707b-7485-484a-a707-bc7a5c93374b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1223 microversion: 2.1 time: 0.193991 Jun 06 14:26:00.631337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 269/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:00 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:00.687408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:00.712322 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:00.716063 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:00.718820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-edefc475-a64f-4a7c-af0d-16a197ca2db7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.299789 Jun 06 14:26:00.720853 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 235/504] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:00 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:00.859383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:00.862072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:00.874914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.878117 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:00.879441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:00.881310 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.136283 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:01.151721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-04a651eb-6ff3-4635-955e-9050ed577cd4 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1504 microversion: 2.1 time: 0.303475 Jun 06 14:26:01.153200 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 270/505] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:00 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:01.357256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:01.358171 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:01.367174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.367649 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.368521 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.368951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.603413 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:01.617761 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dd65559b-5297-4692-b1d7-463fb64f1041 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.264630 Jun 06 14:26:01.618683 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 236/506] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:01 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:01.654435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:01.656537 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:01.674614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.676410 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.678437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.679554 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.760265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:01.765180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:01.798190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.802434 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.805243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.806371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.868163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:01.885949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-978602c6-5e6e-4c69-8ca8-8714a7b2d2df tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1279 microversion: 2.1 time: 0.242095 Jun 06 14:26:01.886612 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 271/507] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:01 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:01.893672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-2d367b57-e810-4f32-a68d-e308acba60f0 req-f680b744-bcfd-4ea1-8cd2-1803b2ccda48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a7b1c1-18c9-431e-839a-25a63bc33fe9", "name": "network-vif-deleted", "tag": "228a9f37-892f-4ca1-b8b8-148e5cd63752"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:01.902346 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2d367b57-e810-4f32-a68d-e308acba60f0 req-f680b744-bcfd-4ea1-8cd2-1803b2ccda48 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:01.902788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2d367b57-e810-4f32-a68d-e308acba60f0 req-f680b744-bcfd-4ea1-8cd2-1803b2ccda48 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:01.919800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-2d367b57-e810-4f32-a68d-e308acba60f0 req-f680b744-bcfd-4ea1-8cd2-1803b2ccda48 service nova] Creating event network-vif-deleted:228a9f37-892f-4ca1-b8b8-148e5cd63752 for instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 on hv-cinder-84414 Jun 06 14:26:01.928112 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-2d367b57-e810-4f32-a68d-e308acba60f0 req-f680b744-bcfd-4ea1-8cd2-1803b2ccda48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 Jun 06 14:26:01.928800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 272/508] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:02.000252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:02.003172 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:02.011468 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:02.012968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:02.014213 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6b4a5d7c-b02f-46a5-9d87-955f157c9f6b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.263864 Jun 06 14:26:02.014787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 237/509] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:01 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:02.175722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:02.176710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:02.184130 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:02.185122 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:02.186244 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:02.187340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:02.287385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:02.312446 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-22536a05-1a1c-451f-a150-724d4028d188 tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1299 microversion: 2.1 time: 0.141038 Jun 06 14:26:02.313972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 273/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:02 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:02.647103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:02.648091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:02.660660 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:02.662121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:02.663856 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:02.665346 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:02.911784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:02.913144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:02.921954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:02.926235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:02.926945 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:02.928270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:02.928990 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:02.937578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a0f51084-e488-4233-9623-04bcd990eb55 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1370 microversion: 2.1 time: 0.297879 Jun 06 14:26:02.939673 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 238/511] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:02 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:03.036698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:03.037591 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:03.045599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.046247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:03.047259 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.048054 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:03.304571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:03.320549 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:03.321125 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-46f0d91d-a742-4773-a4d1-1a672c136f06 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.418667 Jun 06 14:26:03.322151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 274/512] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:02 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:03.336907 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:03.338072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:03.339061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:03.340994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:03.342243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f5fbb788-479f-4226-a3c5-93b9752e0dbc tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.311938 Jun 06 14:26:03.343079 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 239/513] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:03 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:03.349891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.350689 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:03.352136 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.352850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:03.391561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.392004 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:03.392491 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lazy-loading 'fault' on Instance uuid f4a7b1c1-18c9-431e-839a-25a63bc33fe9 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:03.465370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6197b2673c3e41eaac7ca07ad56aab1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87c64a64f6864b84867141833e107e9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:03.480072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-650112f6-6ea0-428a-89c1-ae32d04aadfe tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 200 len: 1304 microversion: 2.1 time: 0.150418 Jun 06 14:26:03.481384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 275/514] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:03 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:03.964682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:03.965918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:03.974084 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.975179 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:03.976840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:03.977525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.306736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:04.321327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dcd848ef-9fc0-46ce-91a0-935704ed6e51 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1565 microversion: 2.1 time: 0.360216 Jun 06 14:26:04.322269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 240/515] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:03 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1565 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:04.341193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:04.344680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:04.349254 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:04.352266 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:04.369420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.373455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.373455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.373455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.378010 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.378493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.379174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.379809 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.623331 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4810e69c-e44d-4b44-b555-16043860af4b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.288226 Jun 06 14:26:04.624008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 276/516] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:26:04 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-interface => generated 285 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:04.629563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:04.630064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:04.637911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.638320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.639366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.639826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.936462 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:04.950476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4dadcf1e-d833-47c9-a551-80ebfd686613 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.609129 Jun 06 14:26:04.951668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 241/517] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:04 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:04.961147 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:04.962808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] [instance: f4a7b1c1-18c9-431e-839a-25a63bc33fe9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:04.976429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.977519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.979076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:04.980514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:04.980744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:04.983761 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:05.010770 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:05.014545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:05.016721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0ee610dc-d2b6-4148-9a3f-4ce4e6369ed8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.391483 Jun 06 14:26:05.018709 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 277/518] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:04 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] HTTP exception thrown: Instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 could not be found. Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Request method failure captured: Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 HTTP/1.1 Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing4iTnBidUwlTyEbK99zqOeQWxGNILsZvBOrgq4hWc3P7c6C2ZLbQbeflUQDemAv7xvpv3BXhA14zT0PkoAprJnFiyB44ErXXH0OXU3ztU-69ZULy_GmVMNx1IvdOZ94WyZYFVl9OMiD3Z5bXvESoP61QaO3jzbOxsM2WYOL_iODx4c Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 87c64a64f6864b84867141833e107e9f Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesActionsTest-1748672813 Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:26:05.027495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/87c64a64f6864b84867141833e107e9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/87c64a64f6864b84867141833e107e9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_87c64a64f6864b84867141833e107e9f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/87c64a64f6864b84867141833e107e9f"}]}] Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesActionsTest-1748672813 Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 87c64a64f6864b84867141833e107e9f Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesActionsTest-1748672813 Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesActionsTest-1748672813-project Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 6197b2673c3e41eaac7ca07ad56aab1f Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesActionsTest-1748672813-project Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 could not be found. Jun 06 14:26:05.030105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'f4a7b1c1-18c9-431e-839a-25a63bc33fe9'} Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 could not be found. Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:26:05.031650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 could not be found. Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 could not be found. Jun 06 14:26:05.034562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:05.036546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] Returning 404 to user: Instance f4a7b1c1-18c9-431e-839a-25a63bc33fe9 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:26:05.036546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ddbfbe04-56db-478f-aabe-f6d1fc9f753f tempest-VolumesActionsTest-1748672813 tempest-VolumesActionsTest-1748672813-project] 10.222.0.13 "GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9" status: 404 len: 111 microversion: 2.1 time: 0.072889 Jun 06 14:26:05.036546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 242/519] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:04 2022] GET /compute/v2.1/servers/f4a7b1c1-18c9-431e-839a-25a63bc33fe9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:26:05.040305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-bdbfcdbb-abd6-4b6c-8ec9-9d8a7f983f44 req-78eb2b62-af70-473c-a0c9-937c5bbb9642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2078f8bb-17de-408d-b489-802bf66b5567", "tag": "23d90c71-9957-48b8-9ec9-c3ee2291dd07"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:05.072809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-bdbfcdbb-abd6-4b6c-8ec9-9d8a7f983f44 req-78eb2b62-af70-473c-a0c9-937c5bbb9642 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:05.075625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-bdbfcdbb-abd6-4b6c-8ec9-9d8a7f983f44 req-78eb2b62-af70-473c-a0c9-937c5bbb9642 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:05.109234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-bdbfcdbb-abd6-4b6c-8ec9-9d8a7f983f44 req-78eb2b62-af70-473c-a0c9-937c5bbb9642 service nova] Creating event network-changed:23d90c71-9957-48b8-9ec9-c3ee2291dd07 for instance 2078f8bb-17de-408d-b489-802bf66b5567 on hv-cinder-84414 Jun 06 14:26:05.117753 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-bdbfcdbb-abd6-4b6c-8ec9-9d8a7f983f44 req-78eb2b62-af70-473c-a0c9-937c5bbb9642 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092641 Jun 06 14:26:05.118644 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 278/520] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:05.977674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:05.979086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:05.988258 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:05.989177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:05.990242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:05.991071 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:06.016390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-65fc7108-0921-4c3e-9f31-310dc5e04739 req-0ba5c8ad-251f-47da-aaca-dc77ffeff4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50386bc4-52ea-44da-834e-381f38cc47c3", "tag": "df54d3c7-86bf-4c37-ba45-0d8672392f1d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:06.046568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-65fc7108-0921-4c3e-9f31-310dc5e04739 req-0ba5c8ad-251f-47da-aaca-dc77ffeff4dc service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:06.047029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-65fc7108-0921-4c3e-9f31-310dc5e04739 req-0ba5c8ad-251f-47da-aaca-dc77ffeff4dc service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:06.060615 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-65fc7108-0921-4c3e-9f31-310dc5e04739 req-0ba5c8ad-251f-47da-aaca-dc77ffeff4dc service nova] Creating event network-changed:df54d3c7-86bf-4c37-ba45-0d8672392f1d for instance 50386bc4-52ea-44da-834e-381f38cc47c3 on hv-cinder-84414 Jun 06 14:26:06.068154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-65fc7108-0921-4c3e-9f31-310dc5e04739 req-0ba5c8ad-251f-47da-aaca-dc77ffeff4dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060285 Jun 06 14:26:06.069105 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 279/521] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:06.075052 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:06.075826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:06.086536 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:06.087328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:06.088591 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:06.089372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:06.256648 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:06.280171 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-024a636e-ece3-4602-ade1-086591c7f5af tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.306648 Jun 06 14:26:06.282148 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 243/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:05 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:06.336324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:06.345774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:06.347654 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:06.349049 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-09e8295a-9e53-46d1-b922-99961a7f1853 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.278750 Jun 06 14:26:06.349618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 280/523] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:06 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:07.307049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:07.307872 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:07.309936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:07.323475 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:07.324438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:07.326261 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:07.327043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:07.371348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:07.372204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:07.376103 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:07.394248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=6 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:07.409445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:07.410311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:07.411978 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:07.412805 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:07.665870 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:07.669907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:07.675588 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:07.677221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:07.678548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4a6e5d74-9ce2-428d-931e-8e0643e240a3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.313755 Jun 06 14:26:07.679072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4ac0863b-26fb-4bbf-b6ec-59c59dfb0be4 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.375577 Jun 06 14:26:07.679265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 281/524] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:07 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:07.679652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 244/525] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:07 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:08.696373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:08.697210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:08.699838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:08.700789 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:08.704438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:08.704930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:08.705773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:08.706225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:08.710236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:08.710786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:08.711645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:08.712155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:08.942695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:08.950798 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bb3754a8-1ad6-4f06-aa79-c80f17afcab5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.258380 Jun 06 14:26:08.951512 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 282/526] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:08 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:08.957541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:08.977330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:08.980257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:08.982206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-68c8d4a5-31d5-4f56-8171-2d9949083128 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.286961 Jun 06 14:26:08.983007 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 245/527] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:08 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:09.968857 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:09.969866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:09.977573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:09.978135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:09.978963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:09.979440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:10.007575 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:10.008285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:10.014908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:10.015444 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:10.016283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:10.016716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:10.209614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:10.220820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1aa87ade-988b-41ee-9d48-2636d102107b tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.254999 Jun 06 14:26:10.221625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 283/528] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:09 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:10.254298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:10.264273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:10.265870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:10.267102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1b1e6357-831f-4539-b64d-18b9b9c2c237 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.265868 Jun 06 14:26:10.267883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 246/529] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:10 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:11.247137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:11.247757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:11.256971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:11.257834 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:11.259217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:11.260009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:11.290406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:11.291239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:11.295354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=84 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:11.303300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:11.303846 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:11.304727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:11.305224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:11.659588 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:11.684327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-28b441b2-7f0a-451b-8e88-4124d34c3cb7 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.441203 Jun 06 14:26:11.686093 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 284/530] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:11 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:11.714885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:11.758334 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:11.761514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:11.764237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a9ac26be-0229-424a-8ead-56fada2375ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.480206 Jun 06 14:26:11.766664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 247/531] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:11 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:12.726883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:12.728573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:12.748315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:12.749357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:12.751075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:12.752654 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:12.795686 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:12.797266 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:12.814831 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:12.815288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:12.820492 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:12.820953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:13.083977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:13.099744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:13.101371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:13.102629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8a41e175-7e12-4fdf-a5e5-7aa1637dfb27 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.314600 Jun 06 14:26:13.103476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 248/532] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:12 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:13.123401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-0a00b364-a539-4271-829b-dd23670c49f8 req-ed6e7a5e-ee95-4fce-8f5f-212896ed5e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "name": "network-vif-plugged", "status": "completed", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:13.135967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-0a00b364-a539-4271-829b-dd23670c49f8 req-ed6e7a5e-ee95-4fce-8f5f-212896ed5e67 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:13.136514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-0a00b364-a539-4271-829b-dd23670c49f8 req-ed6e7a5e-ee95-4fce-8f5f-212896ed5e67 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:13.153406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-0a00b364-a539-4271-829b-dd23670c49f8 req-ed6e7a5e-ee95-4fce-8f5f-212896ed5e67 service nova] Creating event network-vif-plugged:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:26:13.160639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-0a00b364-a539-4271-829b-dd23670c49f8 req-ed6e7a5e-ee95-4fce-8f5f-212896ed5e67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042094 Jun 06 14:26:13.162141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 249/533] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:13.227263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:13.244115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-026d8a47-c8f2-4793-b776-63db262e39e2 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.538598 Jun 06 14:26:13.246035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 285/534] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:12 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:14.141474 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:14.150759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:14.167870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:14.168426 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:14.169445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:14.170190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:14.266383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:14.269014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:14.287545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:14.289067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:14.291106 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:14.291901 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:14.533394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:14.547255 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:14.552289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:14.558673 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d83d57bc-270d-4588-91ad-ae000fcf1fea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.423566 Jun 06 14:26:14.560269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 250/535] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:14 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:14.657007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:14.668411 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-858a6121-141c-4f93-a637-010046a36fd9 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.409066 Jun 06 14:26:14.669320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 286/536] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:14 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:15.587531 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:15.589324 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:15.600805 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:15.601649 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:15.602852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:15.608933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:15.696228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:15.698901 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:15.722589 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:15.725173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:15.727262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:15.728765 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:15.945512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:15.957117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:15.960344 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:15.962582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d9cb66d2-5bed-4951-ad47-37dc788e7291 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.379529 Jun 06 14:26:15.978889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 251/537] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:15 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:16.007145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:16.017935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-19d3b39c-00d1-4eba-9564-a78c4a1c7688 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.333026 Jun 06 14:26:16.018567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 287/538] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:15 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:16.990976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:16.991581 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:17.012894 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:17.013652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:17.015103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:17.015785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:17.036354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:17.037922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:17.055584 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:17.059010 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:17.060445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:17.064600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:17.461501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:17.487898 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c29ae2ff-31a5-4b1c-a8cc-6a0aafe4a859 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.456269 Jun 06 14:26:17.489968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 288/539] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:17 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:17.494629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:17.528192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:17.535881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:17.539422 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-934a9fa5-72ec-4662-90ed-a1112b24630d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1809 microversion: 2.20 time: 0.552496 Jun 06 14:26:17.542371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 252/540] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:16 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1809 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:26:18.516780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:18.518007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:18.531273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:18.533104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:18.535461 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:18.536823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:18.568906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:18.569837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:18.584467 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:18.584998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:18.585762 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:18.586189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:18.897820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:18.915105 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:18.922327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:18.929228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:18.933354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-198cba33-c110-43ed-99ff-b4fc46f8c0b3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1796 microversion: 2.20 time: 0.369913 Jun 06 14:26:18.936992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-44c96d3b-da0b-4f78-a87c-15de298a3506 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.427494 Jun 06 14:26:18.940098 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 253/541] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:26:18 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1796 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:26:18.941574 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 289/542] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:18 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:19.137049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-17a17795-2282-4afc-8e48-084e04eb83cf req-c51a3f4e-e26d-46e7-8829-d97383e4856b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2078f8bb-17de-408d-b489-802bf66b5567", "name": "network-vif-plugged", "status": "completed", "tag": "23d90c71-9957-48b8-9ec9-c3ee2291dd07"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:19.149905 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-17a17795-2282-4afc-8e48-084e04eb83cf req-c51a3f4e-e26d-46e7-8829-d97383e4856b service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:19.150878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-17a17795-2282-4afc-8e48-084e04eb83cf req-c51a3f4e-e26d-46e7-8829-d97383e4856b service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:19.167724 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-17a17795-2282-4afc-8e48-084e04eb83cf req-c51a3f4e-e26d-46e7-8829-d97383e4856b service nova] Creating event network-vif-plugged:23d90c71-9957-48b8-9ec9-c3ee2291dd07 for instance 2078f8bb-17de-408d-b489-802bf66b5567 on hv-cinder-84414 Jun 06 14:26:19.178132 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-17a17795-2282-4afc-8e48-084e04eb83cf req-c51a3f4e-e26d-46e7-8829-d97383e4856b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046106 Jun 06 14:26:19.179389 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 254/543] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:19.959880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:19.961308 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:19.975711 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:19.976522 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:19.977362 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:19.977853 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:20.219342 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:20.234253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f7026edc-0321-4feb-8cd1-575f38d36c26 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.278705 Jun 06 14:26:20.243296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 290/544] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:19 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:21.265214 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:21.266306 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:21.286070 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:21.286878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:21.290826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:21.291825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:21.566343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:21.578360 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7051b10b-f306-48e6-ac1e-e9aeb0a1f572 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1319 microversion: 2.1 time: 0.320715 Jun 06 14:26:21.582441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 255/545] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:21 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:22.608940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:22.609635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:22.623878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:22.624759 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:22.627298 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:22.628354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:22.856674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1318450148", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:22.875685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:22.884808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b709c53c-5297-49a2-bf5a-151c8f867d99 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1508 microversion: 2.1 time: 0.281213 Jun 06 14:26:22.886152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 291/546] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:22 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:22.910812 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "666e9057-41a0-4eb1-9a63-698c8e106611", "device": "/dev/sdb"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:22.913535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:22.928468 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:22.929507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:22.931013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:22.931830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:22.940527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] validate_networks() for None {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:26:23.415339 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4bbb92b7-0e58-4cc9-8636-373f4e577fc8 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "POST /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509113 Jun 06 14:26:23.417930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 292/547] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:26:22 2022] POST /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:23.493872 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:26:23.494704 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:26:23.495577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:26:23.496301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:26:23.497323 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:26:23.522627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:23.524461 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:23.525578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:23.526226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:23.567748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Getting quotas for project 40a9c7b67e894fe09b04ab789b32b405. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:26:23.567748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Getting quotas for user e7d45ab3d8e845c98c77da382e0c3e80 and project 40a9c7b67e894fe09b04ab789b32b405. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:26:23.579757 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:26:23.582297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:26:23.639163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-be7178a1-57f6-4f9f-8532-72af9411574f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790797 Jun 06 14:26:23.640302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 256/548] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:26:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:26:23.654891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-391b430d-9ba6-4207-b42a-5993cf80601e tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:23.656587 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-391b430d-9ba6-4207-b42a-5993cf80601e tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:23.740137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-391b430d-9ba6-4207-b42a-5993cf80601e tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:23.748433 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-391b430d-9ba6-4207-b42a-5993cf80601e tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1215 microversion: 2.1 time: 0.099762 Jun 06 14:26:23.752021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 293/549] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:23 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:24.780077 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:24.780932 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:24.790558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:24.791443 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:24.792627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:24.793450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:24.797323 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:24.885384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:24.897353 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-90b05010-7e9a-4e4e-9b42-6beec1839bb3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1267 microversion: 2.1 time: 0.123404 Jun 06 14:26:24.898514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 257/550] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:24 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:25.590009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:25.590590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:25.598234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:25.600366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:25.601035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:25.602107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:25.602721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:25.820007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lazy-loading 'services' on Instance uuid 9070a8fe-f081-4116-9cf2-81094e156184 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:25.927836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:25.930072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:25.956005 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:25.959647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:25.960660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:25.963269 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:25.970563 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:25.988524 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5e1c1fed-d19d-433d-9d64-e70235d938cf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-volume_attachments/9a9d597e-8738-40f1-8091-cdb50e5ddec3" status: 202 len: 0 microversion: 2.1 time: 0.401950 Jun 06 14:26:25.990401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 294/551] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:26:25 2022] DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-volume_attachments/9a9d597e-8738-40f1-8091-cdb50e5ddec3 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 14:26:26.162287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:26.179411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1a445c5d-a97e-4d05-b0b8-bb6d085a3334 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1273 microversion: 2.1 time: 0.262282 Jun 06 14:26:26.195283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 258/552] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:25 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:27.222246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:27.223601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:27.244233 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:27.245480 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:27.247385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:27.251235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:27.537089 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:27.567275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-42f2b76e-3b9d-48b1-84b5-ddce60395935 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.359277 Jun 06 14:26:27.580712 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 295/553] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:27 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:28.596530 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:28.600743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:28.613273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:28.614083 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:28.615193 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:28.615899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:28.714095 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-553baab0-bfff-4bc1-89d7-abd78a961e3b req-6d44b910-75c1-46b4-9dcd-b4cca465899f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f039817c-c8ac-4bcb-863f-1fe73fbdfbc7", "tag": "9b656ba1-8cc9-4fe8-a7d4-591cee57ac2b"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:28.748514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-553baab0-bfff-4bc1-89d7-abd78a961e3b req-6d44b910-75c1-46b4-9dcd-b4cca465899f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:28.754810 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-553baab0-bfff-4bc1-89d7-abd78a961e3b req-6d44b910-75c1-46b4-9dcd-b4cca465899f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:28.822018 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-553baab0-bfff-4bc1-89d7-abd78a961e3b req-6d44b910-75c1-46b4-9dcd-b4cca465899f service nova] Creating event network-changed:9b656ba1-8cc9-4fe8-a7d4-591cee57ac2b for instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 on hv-cinder-84414 Jun 06 14:26:28.867088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-553baab0-bfff-4bc1-89d7-abd78a961e3b req-6d44b910-75c1-46b4-9dcd-b4cca465899f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166684 Jun 06 14:26:28.872967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 296/554] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:28.978106 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:28.998301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5d1a20a6-dde4-4cb3-bbc9-fed52333fbc9 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.405943 Jun 06 14:26:28.999867 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 259/555] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:28 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:30.020306 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:30.021676 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:30.030424 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:30.031178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:30.032862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:30.034019 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:30.209288 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:30.218068 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7a580a92-526b-4af3-b6a0-3f2ab075d011 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.205166 Jun 06 14:26:30.230187 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 297/556] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:30 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:31.241651 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:31.244287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:31.258851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:31.260250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:31.262918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:31.264620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:31.467080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:31.476561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4393a17a-0389-4d65-b19a-36aa85780c99 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.243005 Jun 06 14:26:31.481288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 260/557] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:31 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:32.496413 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:32.497041 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:32.505509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:32.506021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:32.506825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:32.507268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:32.663610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:32.678388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9dc5b4c1-fff9-47f9-bb21-4ac84a5fa20a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.185426 Jun 06 14:26:32.679482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 298/558] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:32 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:33.696608 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:33.697627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:33.700459 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:33.701282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:33.708336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:33.708862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:33.709725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:33.710230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:33.884797 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:33.894317 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d2bdc5bf-c41e-4279-9f2f-64cfe13f322a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.201367 Jun 06 14:26:33.895083 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 261/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:33 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:34.912763 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:34.914000 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:34.916961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:34.924790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:34.925414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:34.926661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:34.927254 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:35.104028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:35.116227 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8ea39218-bdbd-4c9a-8368-1e59d1f7461f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.207981 Jun 06 14:26:35.117510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 299/560] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:34 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:36.043571 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-97809b2a-9d6a-4164-b243-c2d8def29760 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:36.056793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97809b2a-9d6a-4164-b243-c2d8def29760 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:36.057661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97809b2a-9d6a-4164-b243-c2d8def29760 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:36.102043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-97809b2a-9d6a-4164-b243-c2d8def29760 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Going to try to stop instance {{(pid=117604) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 14:26:36.136873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:36.137948 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:36.164702 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:36.165919 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:36.167348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:36.168529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:36.224232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-97809b2a-9d6a-4164-b243-c2d8def29760 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action" status: 202 len: 0 microversion: 2.1 time: 0.181491 Jun 06 14:26:36.224232 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 262/561] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:26:36 2022] POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 14:26:36.239534 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:36.240760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:36.291073 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:36.294510 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:36.296033 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:36.296744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:36.469782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:36.478143 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0c63149b-4bfd-4e4f-97ad-f772b7cf7cc3 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.346714 Jun 06 14:26:36.478905 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 300/562] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:36 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:36.541443 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:36.550381 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4c154501-08a2-4b46-9970-565a64ad90fa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.322818 Jun 06 14:26:36.551438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 263/563] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:36 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:37.495799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:37.496482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:37.505467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:37.506146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:37.507036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:37.507543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:37.575509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:37.576526 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:37.587833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:37.588403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:37.589858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:37.590663 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:37.729223 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:37.739207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-41f38687-8c70-417c-acea-6b70d6f814c6 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.247347 Jun 06 14:26:37.739979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 301/564] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:37 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:37.782807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:37.791041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2fc06c1a-9b2d-40ee-9828-8b77b4b028d2 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.220142 Jun 06 14:26:37.791726 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 264/565] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:37 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:38.768278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:38.768859 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:38.776212 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:38.776657 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:38.777488 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:38.777964 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:38.814385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:38.815447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:38.825697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:38.826320 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:38.827301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:38.827803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:39.012869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:39.024922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3fb6ba5d-b9fe-40f2-a5b8-5194ff0f165a tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.262103 Jun 06 14:26:39.026067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 302/566] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:38 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:39.043632 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:39.056012 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e3e1630d-2bf6-4d16-b5c1-940e527ef324 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.249194 Jun 06 14:26:39.057008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 265/567] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:38 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:39.831202 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-784d67e5-0fc2-46e1-bf71-74538235deb8 req-34be7b83-dbae-40f6-b542-d9c1678aae1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f039817c-c8ac-4bcb-863f-1fe73fbdfbc7", "name": "network-vif-plugged", "status": "completed", "tag": "9b656ba1-8cc9-4fe8-a7d4-591cee57ac2b"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:39.843301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-784d67e5-0fc2-46e1-bf71-74538235deb8 req-34be7b83-dbae-40f6-b542-d9c1678aae1e service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:39.844497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-784d67e5-0fc2-46e1-bf71-74538235deb8 req-34be7b83-dbae-40f6-b542-d9c1678aae1e service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:39.860825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-784d67e5-0fc2-46e1-bf71-74538235deb8 req-34be7b83-dbae-40f6-b542-d9c1678aae1e service nova] Creating event network-vif-plugged:9b656ba1-8cc9-4fe8-a7d4-591cee57ac2b for instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 on hv-cinder-84414 Jun 06 14:26:39.866935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-784d67e5-0fc2-46e1-bf71-74538235deb8 req-34be7b83-dbae-40f6-b542-d9c1678aae1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041586 Jun 06 14:26:39.867532 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 303/568] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:40.052016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:40.053067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:40.064185 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.064983 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.066427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.067186 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.087963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:40.089009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:40.099029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.099720 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.101121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.101910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.337175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:40.348549 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4ddd3be4-168a-4f3f-bc68-6e22051f9ce8 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.304801 Jun 06 14:26:40.349672 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 266/569] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:40 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:40.355985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:40.357530 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:40.363582 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:40.368665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.370017 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.371693 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.372788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.373201 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2dd76976-a2ae-4f53-a892-a692f29b02f3 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.290852 Jun 06 14:26:40.374067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 304/570] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:40 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:40.409470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-59c23af4-9957-4ea9-b443-811ea63bfa43 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/ips" status: 200 len: 151 microversion: 2.1 time: 0.058047 Jun 06 14:26:40.418220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 267/571] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:26:40 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/ips => generated 151 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:40.425729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b32ec29c-ae54-4538-8e0a-c31b46056568"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:40.427081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:40.434164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.434864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.435829 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.436525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.591408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Invalid volume: volume b32ec29c-ae54-4538-8e0a-c31b46056568 is already attached to instances: a01d925b-d495-41e1-8810-5c4a905137f7 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/os-volume_attachments HTTP/1.1 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 74 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:26:40.596344 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {"volumeAttachment": {"volumeId": "b32ec29c-ae54-4538-8e0a-c31b46056568"}} Jun 06 14:26:40.598785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Invalid volume: volume b32ec29c-ae54-4538-8e0a-c31b46056568 is already attached to instances: a01d925b-d495-41e1-8810-5c4a905137f7 Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': '9df4fe33-1d83-4d2c-ab48-dbdd31902a0f', 'body': {'volumeAttachment': {'volumeId': 'b32ec29c-ae54-4538-8e0a-c31b46056568'}}} Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b32ec29c-ae54-4538-8e0a-c31b46056568 is already attached to instances: a01d925b-d495-41e1-8810-5c4a905137f7 Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:40.600124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b32ec29c-ae54-4538-8e0a-c31b46056568 is already attached to instances: a01d925b-d495-41e1-8810-5c4a905137f7 Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:40.602238 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:40.604880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:40.604880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:26:40.604880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:26:40.604880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b32ec29c-ae54-4538-8e0a-c31b46056568 is already attached to instances: a01d925b-d495-41e1-8810-5c4a905137f7 Jun 06 14:26:40.604880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:40.610626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 400 to user: Invalid volume: volume b32ec29c-ae54-4538-8e0a-c31b46056568 is already attached to instances: a01d925b-d495-41e1-8810-5c4a905137f7 {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:26:40.610626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ff1c6706-c92d-48f0-b1e9-36587139fa3b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188489 Jun 06 14:26:40.610966 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 305/572] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:26:40 2022] POST /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f/os-volume_attachments => generated 174 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 14:26:40.629851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:40.630536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:40.640179 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.640704 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.641700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.642274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.696967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:26:40.826016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f89a648e-0b81-4cec-929d-b5eb2a9dd2e4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 204 len: 0 microversion: 2.1 time: 0.202585 Jun 06 14:26:40.827096 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 268/573] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:26:40 2022] DELETE /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:26:40.840188 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:40.841321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:40.858662 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.859463 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:40.862108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:40.862900 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:41.238125 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:41.258245 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b1186f54-1b3b-49ab-81a6-a18d3b55fd74 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1684 microversion: 2.1 time: 0.425162 Jun 06 14:26:41.272967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 306/574] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:40 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1684 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:41.367665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:41.369327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:41.372379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:41.383015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:41.383305 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:41.383931 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:41.384339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:41.397296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:41.398562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:41.406297 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:41.407212 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:41.408435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:41.409144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:41.634816 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:41.658284 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-01c41217-ba9f-4f1a-9479-ba2af4eb578d tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.294814 Jun 06 14:26:41.659027 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 269/575] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:41 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:41.686159 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:41.697462 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-de44fa6b-f164-4145-a547-035dc090d5a4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.303965 Jun 06 14:26:41.698385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 307/576] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:41 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:42.284627 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:42.285252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:42.291798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:42.292278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:42.293041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:42.293562 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:42.449152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:42.459136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-133a5ea6-627f-4a7d-9852-e5ebf61b3074 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1684 microversion: 2.1 time: 0.178962 Jun 06 14:26:42.459970 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 270/577] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:42 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:42.677832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:42.678636 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:42.688852 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:42.689442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:42.690445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:42.691000 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:42.723708 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:42.724327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:42.731210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:42.731661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:42.732446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:42.733078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:42.754319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:42.975325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:42.986774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c6355e9e-0ddb-4c4c-927f-a5c71f468249 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1315 microversion: 2.1 time: 0.314582 Jun 06 14:26:42.988558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 308/578] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:42 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:43.010684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:43.019933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d3147ce6-1dfa-4bbd-bf01-b74e96f7ccdc tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.300124 Jun 06 14:26:43.020527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 271/579] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:42 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:43.489418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:43.490600 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:43.500673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:43.501474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:43.503278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:43.504390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:43.687448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:43.705401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-24053819-15f0-43ea-b7c4-e038c700a6de tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1684 microversion: 2.1 time: 0.220294 Jun 06 14:26:43.706677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 309/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:43 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1684 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:44.019859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:44.020749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:44.021212 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:44.022424 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:44.035047 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.035245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.035775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.035929 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.037038 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.040258 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.040509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.040668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.143416 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lazy-loading 'services' on Instance uuid 2078f8bb-17de-408d-b489-802bf66b5567 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:44.247113 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:44.261687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-46ad19e9-4a1b-4219-80e7-4e067ad17408 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1465 microversion: 2.1 time: 0.249266 Jun 06 14:26:44.263507 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 272/581] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:44 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:44.274213 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:44.276602 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:44.276770 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-76e1c62f-c0dd-4bc2-8aa0-447f347ccd41 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567/os-volume_attachments/666e9057-41a0-4eb1-9a63-698c8e106611" status: 202 len: 0 microversion: 2.1 time: 0.262954 Jun 06 14:26:44.277862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 310/582] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:26:44 2022] DELETE /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567/os-volume_attachments/666e9057-41a0-4eb1-9a63-698c8e106611 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:26:44.289854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.291515 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.293135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.294206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.345685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:44.346678 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:44.357111 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.358185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.359197 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.360597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.424025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:26:44.453739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:44.549947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:44.566607 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-12de916e-dfb8-4dff-b261-ef9fb164263e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.301165 Jun 06 14:26:44.568825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 273/583] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:44 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:44.589116 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-46a8c5d1-069d-44ed-a21a-e3cfe6da9c76 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 204 len: 0 microversion: 2.1 time: 0.252945 Jun 06 14:26:44.589799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 311/584] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:26:44 2022] DELETE /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:26:44.603059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:44.604084 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:44.614593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.614974 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.616787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.617093 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.726437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:44.728893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:44.770374 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.771193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.772793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:44.773592 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:44.937452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:44.941142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:44.955817 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-84387ecd-cc6e-4b88-a245-fd75c3ed7490 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1471 microversion: 2.1 time: 0.359167 Jun 06 14:26:44.957292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 274/585] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:44 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:44.957842 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c821d3f1-9188-4618-98ca-7a8fcd334dfd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1616 microversion: 2.1 time: 0.234834 Jun 06 14:26:44.959649 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 312/586] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:44 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1616 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:45.213814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-e17e4dc9-e679-42be-9215-c1e389547e2d req-5f86947b-ac26-41f0-911d-46f5c7ef5ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df4fe33-1d83-4d2c-ab48-dbdd31902a0f", "name": "network-vif-deleted", "tag": "4c84088c-bb71-4e25-a2b8-07695dfe32a8"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:45.231957 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e17e4dc9-e679-42be-9215-c1e389547e2d req-5f86947b-ac26-41f0-911d-46f5c7ef5ff2 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:45.233301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e17e4dc9-e679-42be-9215-c1e389547e2d req-5f86947b-ac26-41f0-911d-46f5c7ef5ff2 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:45.255676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-e17e4dc9-e679-42be-9215-c1e389547e2d req-5f86947b-ac26-41f0-911d-46f5c7ef5ff2 service nova] Creating event network-vif-deleted:4c84088c-bb71-4e25-a2b8-07695dfe32a8 for instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f on hv-cinder-84414 Jun 06 14:26:45.263351 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-e17e4dc9-e679-42be-9215-c1e389547e2d req-5f86947b-ac26-41f0-911d-46f5c7ef5ff2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060642 Jun 06 14:26:45.268583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 275/587] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:45.598940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:45.600512 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:45.614894 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:45.616109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:45.617917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:45.619027 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:45.882637 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:45.895005 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-191cdf8f-5c03-4677-839e-bc1c66e0cae5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.304346 Jun 06 14:26:45.895738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 313/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:45 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:45.986572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:45.988386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:45.993656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:45.995269 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:46.008470 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:46.009736 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:46.011823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:46.013095 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:46.019945 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:46.022447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:46.023300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:46.023740 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:46.200369 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:46.227551 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c1832e7c-8a36-4c2f-907a-1fa21285b6b3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1616 microversion: 2.1 time: 0.243563 Jun 06 14:26:46.259419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 314/589] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:45 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1616 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:46.383287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:46.396187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fe5a3344-9514-4a85-9aef-6a8c2028d8c7 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1471 microversion: 2.1 time: 0.419503 Jun 06 14:26:46.398782 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 276/590] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:45 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1471 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:46.919465 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:46.920497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:46.951972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:46.956651 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:46.960840 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:46.965164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.267856 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:47.272546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:47.278299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:47.299968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e46813f3-6d03-437f-bb10-b8f762379b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.389993 Jun 06 14:26:47.301774 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.302298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.303176 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.303705 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.310217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 315/591] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:46 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:47.356430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.357138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.357797 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'fault' on Instance uuid 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:47.422877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:47.428824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:47.433455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:47.434192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-315bf8bc-cd43-4302-b170-289d60e27121 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 200 len: 1332 microversion: 2.1 time: 0.179804 Jun 06 14:26:47.447778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 277/592] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:47 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 1332 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:47.467135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.470497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.472288 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.473787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.655337 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:47.655833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:47.664297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.665126 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.666192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.666804 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.683232 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:47.693370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2876bf77-9e91-44b5-84c9-b5af3812b73f tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1471 microversion: 2.1 time: 0.273048 Jun 06 14:26:47.694732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 316/593] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:47 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:47.718445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:26:47.839849 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-eee6b35f-12b0-4bd7-bd1e-79e02c00281e tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 204 len: 0 microversion: 2.1 time: 0.188030 Jun 06 14:26:47.840779 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 278/594] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:26:47 2022] DELETE /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 14:26:47.852598 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:47.854467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:47.868170 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.869133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:47.870144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:47.870655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.041625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:48.051753 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8c29258c-a393-4b50-ae27-24862de95ebf tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1514 microversion: 2.1 time: 0.203612 Jun 06 14:26:48.053771 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 317/595] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:47 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:48.225406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-9ba7fb57-2c38-4040-b52c-12eddba3b333 req-c0b44c76-0850-4ebb-8903-cb0e2761743a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f039817c-c8ac-4bcb-863f-1fe73fbdfbc7", "name": "network-vif-deleted", "tag": "9b656ba1-8cc9-4fe8-a7d4-591cee57ac2b"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:48.238858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9ba7fb57-2c38-4040-b52c-12eddba3b333 req-c0b44c76-0850-4ebb-8903-cb0e2761743a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.239537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9ba7fb57-2c38-4040-b52c-12eddba3b333 req-c0b44c76-0850-4ebb-8903-cb0e2761743a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.257996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-9ba7fb57-2c38-4040-b52c-12eddba3b333 req-c0b44c76-0850-4ebb-8903-cb0e2761743a service nova] Creating event network-vif-deleted:9b656ba1-8cc9-4fe8-a7d4-591cee57ac2b for instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 on hv-cinder-84414 Jun 06 14:26:48.265052 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-9ba7fb57-2c38-4040-b52c-12eddba3b333 req-c0b44c76-0850-4ebb-8903-cb0e2761743a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052540 Jun 06 14:26:48.270473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 279/596] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:48.326475 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:48.327295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:48.336161 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.336623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.337428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.337936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.458357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:48.460260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:48.469833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.472647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.474123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.474838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.494878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f HTTP/1.1 Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:26:48.497090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:26:48.498583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '9df4fe33-1d83-4d2c-ab48-dbdd31902a0f'} Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:26:48.499452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:26:48.501551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:26:48.513389 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:26:48.515286 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4fe5f29e-1807-4628-b0ec-88c62785396c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 404 len: 111 microversion: 2.1 time: 0.065493 Jun 06 14:26:48.516898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 280/597] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:48 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:26:48.526243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9b72ef67-4f3c-4a5b-8b9d-9fcf355eef56 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '.version_select at 0x7fae8af58dc0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:48.556144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9b72ef67-4f3c-4a5b-8b9d-9fcf355eef56 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815231813" status: 202 len: 0 microversion: 2.1 time: 0.032318 Jun 06 14:26:48.559135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 281/598] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 14:26:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1815231813 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:26:48.583892 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:48.596869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-18cca701-1042-46cc-9aa6-440e9684826f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.275605 Jun 06 14:26:48.598686 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 318/599] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:48 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:48.720327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:48.720957 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:48.729283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.730087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.730886 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:48.731295 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:48.831630 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:48.841418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dcdfb2a1-93fc-4438-bc7d-6433acd624ce tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1429 microversion: 2.1 time: 0.125416 Jun 06 14:26:48.842144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 282/600] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:48 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:49.085266 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:49.087020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:49.102009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.102885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.104312 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.105372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.526385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:49.536738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0ddce869-f4bd-4a5f-bbb2-567884643a7c tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1514 microversion: 2.1 time: 0.459379 Jun 06 14:26:49.537340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 319/601] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:49 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1514 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:49.632602 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:49.633676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:49.659543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.660312 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.661669 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.662716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.871337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:49.872011 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:49.880039 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.880762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.881734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.882295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.927463 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:49.927976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:49.937280 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:49.939401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lazy-loading 'fault' on Instance uuid f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:49.948767 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-463ef7b5-92df-4e03-8ca5-210f066a2456 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.329988 Jun 06 14:26:49.959893 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 283/602] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:49 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:50.000388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d45ab3d8e845c98c77da382e0c3e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a9c7b67e894fe09b04ab789b32b405', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:50.009472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bdcd9fc1-24ee-485e-a866-85f79b2b6c05 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 200 len: 1305 microversion: 2.1 time: 0.142600 Jun 06 14:26:50.010429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 320/603] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:49 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 1305 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:50.021133 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:50.022043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:50.035449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.036678 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.039049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.039729 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.263198 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'services' on Instance uuid a01d925b-d495-41e1-8810-5c4a905137f7 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:50.430351 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c6199ba-4125-46a9-ab29-2c489d8ac165 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments/b32ec29c-ae54-4538-8e0a-c31b46056568" status: 202 len: 0 microversion: 2.1 time: 0.415954 Jun 06 14:26:50.431662 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 284/604] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:26:50 2022] DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments/b32ec29c-ae54-4538-8e0a-c31b46056568 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 14:26:50.444515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:50.445820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:50.457216 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.458490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.460510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.460914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.523601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b853b448-2cff-4a6b-a159-627dfafd8709 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086859 Jun 06 14:26:50.524577 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 321/605] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:26:50 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:26:50.567532 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:50.567532 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:50.575671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.576195 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.577437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.578321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.683452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:50.699714 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-333a851a-90df-435e-a7f3-6777cb270ea6 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1472 microversion: 2.1 time: 0.139806 Jun 06 14:26:50.700306 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 285/606] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:50 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1472 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:50.742718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-a8e2b9ff-0f6a-472b-8c70-2682be96a243 req-68218760-6e4a-4677-8f3a-4d64046c81f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2078f8bb-17de-408d-b489-802bf66b5567", "name": "network-vif-deleted", "tag": "23d90c71-9957-48b8-9ec9-c3ee2291dd07"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:50.753103 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a8e2b9ff-0f6a-472b-8c70-2682be96a243 req-68218760-6e4a-4677-8f3a-4d64046c81f0 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.753545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a8e2b9ff-0f6a-472b-8c70-2682be96a243 req-68218760-6e4a-4677-8f3a-4d64046c81f0 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.767955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-a8e2b9ff-0f6a-472b-8c70-2682be96a243 req-68218760-6e4a-4677-8f3a-4d64046c81f0 service nova] Creating event network-vif-deleted:23d90c71-9957-48b8-9ec9-c3ee2291dd07 for instance 2078f8bb-17de-408d-b489-802bf66b5567 on hv-cinder-84414 Jun 06 14:26:50.774305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-a8e2b9ff-0f6a-472b-8c70-2682be96a243 req-68218760-6e4a-4677-8f3a-4d64046c81f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036140 Jun 06 14:26:50.774916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 322/607] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:50.968614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:50.969245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:50.976560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.976902 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:50.977809 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:50.978327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.042971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:51.043696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] [instance: f039817c-c8ac-4bcb-863f-1fe73fbdfbc7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:51.054477 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.055247 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.056502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.057140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.075021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] HTTP exception thrown: Instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 could not be found. Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Request method failure captured: Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 HTTP/1.1 Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing6MJFAvn1OUBuvzAAqHbduMbnUmqcO1oyAZdi7JF_1YgbvlMjJoYflB7X5AiRqO6Z5FRqSSG6cyt3mvfZgnjVN2g-XgFdPxhjwzu2A8pHkWiyRJugI2uVK_Dens0lZBJL2AzaQeaTLKDkH3eR1JxNnJV6neZKMTzCxMVvLeTVWzFTk Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 40a9c7b67e894fe09b04ab789b32b405 Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-692981313 Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:26:51.077653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/40a9c7b67e894fe09b04ab789b32b405"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/40a9c7b67e894fe09b04ab789b32b405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_40a9c7b67e894fe09b04ab789b32b405", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/40a9c7b67e894fe09b04ab789b32b405"}]}] Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-692981313 Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 40a9c7b67e894fe09b04ab789b32b405 Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-692981313 Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-692981313-project Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: e7d45ab3d8e845c98c77da382e0c3e80 Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-692981313-project Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 could not be found. Jun 06 14:26:51.079490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'f039817c-c8ac-4bcb-863f-1fe73fbdfbc7'} Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 could not be found. Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:26:51.080277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 could not be found. Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 could not be found. Jun 06 14:26:51.085203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:51.087038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] Returning 404 to user: Instance f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:26:51.087038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3f4eed8f-2187-4a71-a567-23db5a9794d5 tempest-VolumesNegativeTest-692981313 tempest-VolumesNegativeTest-692981313-project] 10.222.0.13 "GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7" status: 404 len: 111 microversion: 2.1 time: 0.041018 Jun 06 14:26:51.087038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 323/608] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:51 2022] GET /compute/v2.1/servers/f039817c-c8ac-4bcb-863f-1fe73fbdfbc7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:26:51.181499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:51.195618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-559d7a38-54d2-45c7-9787-e3cef4ca9daf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1679 microversion: 2.1 time: 0.230766 Jun 06 14:26:51.196952 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 286/609] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:50 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:51.536811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:51.538603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:51.560439 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.575809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.580339 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.586567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.635031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-64568521-1222-4bf2-8562-887ed7cdb133 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102037 Jun 06 14:26:51.636028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 324/610] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:26:51 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 14:26:51.711106 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:51.712014 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:51.731958 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.732604 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:51.733697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:51.739115 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.742243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.745477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.746298 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.747707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.749660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.751053 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.811928 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:26:51.819591 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:51.820500 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:51.821325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lazy-loading 'fault' on Instance uuid 2078f8bb-17de-408d-b489-802bf66b5567 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:51.887972 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:51.902286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ded9372b644c57a9f13fc88ff7fdb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810c087aef3d453cb9c0365467dd9134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:51.917227 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6741482d-7d03-49a4-85a3-bdfbe952e3d0 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 200 len: 1309 microversion: 2.1 time: 0.193465 Jun 06 14:26:51.918203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 325/611] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:51 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:51.998721 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f41b14ec-bde3-4b9d-8dff-f1e9f55b7422 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 204 len: 0 microversion: 2.1 time: 0.292782 Jun 06 14:26:52.004006 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 287/612] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:26:51 2022] DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 14:26:52.013166 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:52.014645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:52.026835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.027655 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.029107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.029944 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.215977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:52.217427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:52.224062 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:52.231076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.232482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.233647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.235095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.238477 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8f4bb06c-ee01-4ff0-8ff6-7364c17f5180 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1683 microversion: 2.1 time: 0.231281 Jun 06 14:26:52.239926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 326/613] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:52 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1683 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:52.454711 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:52.468040 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4951ae6e-2e60-403b-a2dc-f0da906c65e7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1656 microversion: 2.1 time: 0.256192 Jun 06 14:26:52.468690 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 288/614] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:52 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1656 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:52.490815 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-49fe1be7-bff0-4529-a562-a8f7d2348093 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:52.504276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49fe1be7-bff0-4529-a562-a8f7d2348093 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.504931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49fe1be7-bff0-4529-a562-a8f7d2348093 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.552469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-49fe1be7-bff0-4529-a562-a8f7d2348093 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Going to try to start instance {{(pid=117603) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 14:26:52.561788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:52.643563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-49fe1be7-bff0-4529-a562-a8f7d2348093 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action" status: 202 len: 0 microversion: 2.1 time: 0.160691 Jun 06 14:26:52.647773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 327/615] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:26:52 2022] POST /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:26:52.656904 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:52.658175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:52.670276 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.671018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.678676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.679567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.896826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:52.906739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a3447684-f517-4c03-80e4-dabec4c60666 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1665 microversion: 2.1 time: 0.256523 Jun 06 14:26:52.908373 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 289/616] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:52 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1665 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:52.945854 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:52.946653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] [instance: 2078f8bb-17de-408d-b489-802bf66b5567] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:52.955806 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.956263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.957082 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:52.957515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:52.983420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] HTTP exception thrown: Instance 2078f8bb-17de-408d-b489-802bf66b5567 could not be found. Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Request method failure captured: Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 HTTP/1.1 Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing4JQqaLfrLMzYmL2GICuupODySobb2dO9rvqrRo_sVHwiwbQkeCfE2LNXpTx3m-AcOOIoSD66jMKzlNNy8J0MZgWf-H-WdwtP1bw2jQteUzGQGB9Wu3T2uNYSbR2rvZfUS2hpJz8fVchk8tNfyhR89WDKzTi40eyQ-XUakB19Bu7hc Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 810c087aef3d453cb9c0365467dd9134 Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1634713131 Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:26:52.987677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/810c087aef3d453cb9c0365467dd9134"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/810c087aef3d453cb9c0365467dd9134"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_810c087aef3d453cb9c0365467dd9134", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/810c087aef3d453cb9c0365467dd9134"}]}] Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesSnapshotTestJSON-1634713131 Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 810c087aef3d453cb9c0365467dd9134 Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1634713131 Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesSnapshotTestJSON-1634713131-project Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 66ded9372b644c57a9f13fc88ff7fdb6 Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesSnapshotTestJSON-1634713131-project Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 2078f8bb-17de-408d-b489-802bf66b5567 could not be found. Jun 06 14:26:52.990363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '2078f8bb-17de-408d-b489-802bf66b5567'} Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2078f8bb-17de-408d-b489-802bf66b5567 could not be found. Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:26:52.991923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2078f8bb-17de-408d-b489-802bf66b5567 could not be found. Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2078f8bb-17de-408d-b489-802bf66b5567 could not be found. Jun 06 14:26:52.995447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:52.997978 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] Returning 404 to user: Instance 2078f8bb-17de-408d-b489-802bf66b5567 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:26:52.997978 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-781c1aec-fd0e-4ebc-bc20-f56247200ee5 tempest-VolumesSnapshotTestJSON-1634713131 tempest-VolumesSnapshotTestJSON-1634713131-project] 10.222.0.13 "GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567" status: 404 len: 111 microversion: 2.1 time: 0.049470 Jun 06 14:26:52.997978 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 328/617] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:52 2022] GET /compute/v2.1/servers/2078f8bb-17de-408d-b489-802bf66b5567 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:26:53.270292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:53.271193 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:53.280943 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:53.281907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:53.282792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:53.283337 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:53.484485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:53.494824 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-414f47f5-116d-49a6-ae5f-a89638af69bd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1683 microversion: 2.1 time: 0.229917 Jun 06 14:26:53.495446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 290/618] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:53 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:53.930910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:53.931608 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:53.940271 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:53.940846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:53.941669 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:53.942141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:54.143264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:54.151182 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0451625c-71db-472a-9d3d-27be85b70804 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1665 microversion: 2.1 time: 0.224619 Jun 06 14:26:54.154219 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 329/619] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:53 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1665 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:54.523392 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:54.524706 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:54.532678 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:54.533469 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:54.534482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:54.535130 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:54.816054 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:54.831161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5243816c-f2d6-4350-b9cb-3ca0d10a8626 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1683 microversion: 2.1 time: 0.311296 Jun 06 14:26:54.832862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 291/620] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:54 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1683 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:55.175119 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:55.176252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:55.199118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:55.200076 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:55.201141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:55.201857 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:55.445811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:55.454079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8fdaff32-e407-4aff-ae45-6f21c5beda83 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1665 microversion: 2.1 time: 0.285038 Jun 06 14:26:55.454686 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 330/621] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:55 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1665 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:26:55.695379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-515f7bc2-6010-4d30-820a-67bc45b2ef09 req-8457f9cb-9079-421c-9560-eebf7edefd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01d925b-d495-41e1-8810-5c4a905137f7", "name": "network-vif-deleted", "tag": "d717f707-59c5-428c-99f9-a11fbd69fc24"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:26:55.706084 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-515f7bc2-6010-4d30-820a-67bc45b2ef09 req-8457f9cb-9079-421c-9560-eebf7edefd8d service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:55.706606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-515f7bc2-6010-4d30-820a-67bc45b2ef09 req-8457f9cb-9079-421c-9560-eebf7edefd8d service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:55.729144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-515f7bc2-6010-4d30-820a-67bc45b2ef09 req-8457f9cb-9079-421c-9560-eebf7edefd8d service nova] Creating event network-vif-deleted:d717f707-59c5-428c-99f9-a11fbd69fc24 for instance a01d925b-d495-41e1-8810-5c4a905137f7 on hv-cinder-84414 Jun 06 14:26:55.739097 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-515f7bc2-6010-4d30-820a-67bc45b2ef09 req-8457f9cb-9079-421c-9560-eebf7edefd8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047789 Jun 06 14:26:55.740157 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 292/622] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:26:55.858630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:55.859321 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:55.861740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:26:55.867611 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:55.868066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:55.868936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:55.869317 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:55.941570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:55.955440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bdcb9f70-aea0-46eb-b71b-74c188581ac7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1616 microversion: 2.1 time: 0.100619 Jun 06 14:26:55.956480 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 331/623] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:55 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1616 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:56.478840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:56.480430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:56.494447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:56.495191 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:56.496637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:56.497436 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:56.728835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:56.739565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d18afb7f-a943-449c-981b-c036fb0d8757 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1665 microversion: 2.1 time: 0.270443 Jun 06 14:26:56.740597 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 293/624] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:56 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1665 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:56.973091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:56.973670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:56.981229 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:56.981955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:56.983312 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:56.984068 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:57.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:57.070716 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-65033852-5e3e-4ee0-acff-e1eb927072ef tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1616 microversion: 2.1 time: 0.102018 Jun 06 14:26:57.071656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 332/625] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:56 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1616 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:57.757631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:57.758237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:57.766430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:57.766885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:57.767677 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:57.768108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:57.952382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:57.966101 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a227d250-8646-44a1-b04b-5483b9fc3364 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1665 microversion: 2.1 time: 0.212667 Jun 06 14:26:57.966879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 294/626] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:57 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1665 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:58.092020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:58.093064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:58.102755 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:58.103395 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:58.104460 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:58.105558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:58.152069 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:58.152813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:58.153568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'fault' on Instance uuid a01d925b-d495-41e1-8810-5c4a905137f7 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:26:58.224892 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:58.233510 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-809cc646-074a-444b-9da5-c5ee3674b3a8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 200 len: 1332 microversion: 2.1 time: 0.146958 Jun 06 14:26:58.234246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 333/627] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:58 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:58.994340 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:58.995841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:59.006828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:59.007655 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:59.009076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:59.009914 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:59.248660 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:26:59.254961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:59.255789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:26:59.262333 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-55897459-bdd2-4a28-908f-7727aabb710f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1669 microversion: 2.1 time: 0.277781 Jun 06 14:26:59.263391 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 295/628] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:58 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1669 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:26:59.263682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:59.264820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:59.266354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:26:59.267011 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:26:59.284577 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 HTTP/1.1 Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:26:59.286332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:26:59.289309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'a01d925b-d495-41e1-8810-5c4a905137f7'} Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:26:59.291469 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:26:59.294378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:26:59.296992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:26:59.296992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7e375230-e68b-4e6e-abbc-0f2e35414f6b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 404 len: 111 microversion: 2.1 time: 0.039122 Jun 06 14:26:59.296992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 334/629] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:26:59 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:26:59.303643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ecacb14e-e670-4a19-b668-c68a75560d67 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '.version_select at 0x7fae9414aaf0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:26:59.327060 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ecacb14e-e670-4a19-b668-c68a75560d67 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056073589" status: 202 len: 0 microversion: 2.1 time: 0.030480 Jun 06 14:26:59.328640 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 296/630] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 14:26:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056073589 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:27:00.502511 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-104b09ab-ce9e-4963-bec1-efa43100002d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: .version_select at 0x7fae900aba60>, body: {"keypair": {"name": "tempest-keypair-1363899217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7JQTzqBet2p61ZNuXLRUlVloKw8pSTrJuH3q7ajCTHAgHAnDqsY9CiT3FvLwFzcSIf3Ci0l+0UuDIHwoU+UsfdAEFEpsZp1pmLLa1JCzYJJcQR+FlYkjpdotnAUXmgPg=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:00.522436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-104b09ab-ce9e-4963-bec1-efa43100002d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:00.528952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-104b09ab-ce9e-4963-bec1-efa43100002d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:00.576457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-104b09ab-ce9e-4963-bec1-efa43100002d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078700 Jun 06 14:27:00.577756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 335/631] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:27:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:02.706352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1940526584", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c80cddf-8aa7-4709-b4d4-0401b235b6d1"}], "security_groups": [{"name": "tempest-securitygroup--2091115685"}], "key_name": "tempest-keypair-1363899217", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:02.894591 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba13b314-cf0a-4720-a234-bdba83359006"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:02.896744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:02.913964 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:02.915097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:02.918456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:02.919741 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:02.940636 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] validate_networks() for [('5c80cddf-8aa7-4709-b4d4-0401b235b6d1', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:27:03.315824 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c26921f2-dea2-4e15-ba60-51cb5fa784cd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431463 Jun 06 14:27:03.317147 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 336/632] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:27:02 2022] POST /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:03.510971 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:27:03.511621 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:27:03.512463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:27:03.513183 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:27:03.513977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:27:03.529120 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:03.530256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:03.532517 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:03.533267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:03.565458 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:03.570359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:03.584988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:27:03.587386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:27:03.645717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-777db7f6-56df-4fa7-9277-9038956d04a2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.945121 Jun 06 14:27:03.646418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 297/633] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:27:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:27:03.658867 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8b038339-80c6-412e-a9f8-7c8b36b9d58a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:03.659575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8b038339-80c6-412e-a9f8-7c8b36b9d58a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:03.726643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8b038339-80c6-412e-a9f8-7c8b36b9d58a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:03.737474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8b038339-80c6-412e-a9f8-7c8b36b9d58a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1242 microversion: 2.1 time: 0.084156 Jun 06 14:27:03.738299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 337/634] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:03 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:04.757181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:04.758079 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:04.764787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:04.765629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:04.767180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:04.767180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:04.839226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:04.848242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9db2f8c0-249c-4fe5-aa27-a1d623c22eda tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1246 microversion: 2.1 time: 0.095630 Jun 06 14:27:04.849012 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 298/635] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:04 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:05.875001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:05.876533 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:05.887874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:05.888330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:05.889136 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:05.889802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:05.974378 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:05.983031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9a3f5202-c4aa-4807-b19a-1282f24d685f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1246 microversion: 2.1 time: 0.116139 Jun 06 14:27:05.983604 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 338/636] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:05 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1246 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:07.010785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:07.011360 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:07.021815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:07.022367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:07.023271 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:07.023785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:07.135989 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:07.146251 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-54b5ff5e-7ec0-4021-b263-ad08770be026 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1294 microversion: 2.1 time: 0.139521 Jun 06 14:27:07.146998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 299/637] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:07 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1294 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:08.170784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:08.172457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:08.180109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:08.180552 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:08.181356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:08.181911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:08.269174 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:08.277424 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2ca83684-2b94-42f6-9c21-8de3c4c8f84f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1294 microversion: 2.1 time: 0.110487 Jun 06 14:27:08.278061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 339/638] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:08 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:09.295843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:09.297161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:09.306948 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:09.307611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:09.308874 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:09.309556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:09.402800 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:09.414688 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2e352af2-0431-42fa-9494-11ee2db22710 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1300 microversion: 2.1 time: 0.123474 Jun 06 14:27:09.415626 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 300/639] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:09 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:10.438678 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:10.439809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:10.454570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:10.455223 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:10.456106 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:10.456556 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:10.650192 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:10.662679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cc3b7eb5-c5f4-47bd-88ad-e07da45bb6fd tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1368 microversion: 2.1 time: 0.231850 Jun 06 14:27:10.663456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 340/640] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:10 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:11.685094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:11.686424 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:11.698259 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:11.701421 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:11.702428 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:11.704001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:11.704876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:11.751854 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ddcfce61-d169-4c88-9345-667c08b01167 req-0f4060b4-b4af-44b3-8d56-7f987a7ddb60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384c1cd6-c5eb-4375-a766-77ca6bd1b4fc", "tag": "6f067b2c-582f-4229-80f1-49f8804249fb"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:11.781990 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ddcfce61-d169-4c88-9345-667c08b01167 req-0f4060b4-b4af-44b3-8d56-7f987a7ddb60 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:11.784075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ddcfce61-d169-4c88-9345-667c08b01167 req-0f4060b4-b4af-44b3-8d56-7f987a7ddb60 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:11.800406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ddcfce61-d169-4c88-9345-667c08b01167 req-0f4060b4-b4af-44b3-8d56-7f987a7ddb60 service nova] Creating event network-changed:6f067b2c-582f-4229-80f1-49f8804249fb for instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc on hv-cinder-84414 Jun 06 14:27:11.806823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ddcfce61-d169-4c88-9345-667c08b01167 req-0f4060b4-b4af-44b3-8d56-7f987a7ddb60 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062376 Jun 06 14:27:11.807727 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 341/641] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:11.978336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:11.993139 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2193214d-1145-4495-8388-2d1c622d3fd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1368 microversion: 2.1 time: 0.315261 Jun 06 14:27:11.995078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 301/642] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:11 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:13.019969 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:13.021045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:13.031155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:13.031938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:13.033193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:13.033994 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:13.206733 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:13.215767 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-93fd0434-e341-4071-82d2-0e5f40ec736f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1368 microversion: 2.1 time: 0.205798 Jun 06 14:27:13.216390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 342/643] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:13 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:14.236953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:14.237635 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:14.240265 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:14.241173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:14.247961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:14.248454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:14.249524 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:14.250051 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:14.703375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:14.711646 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b233e38a-c551-43ac-b567-dcc46d659f29 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1368 microversion: 2.1 time: 0.480016 Jun 06 14:27:14.712238 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 302/644] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:14 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1368 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:15.737449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:15.738332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:15.740263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=6 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:15.747285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:15.747734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:15.749605 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:15.750358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:16.068843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:16.079165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f35965b0-b2e2-4dbd-a340-61cf2bdf3f30 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1368 microversion: 2.1 time: 0.347168 Jun 06 14:27:16.079773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 343/645] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:15 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1368 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:16.199522 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-53c55f28-5607-4b14-b1fb-56d7ee45987d req-8990192d-74ab-42e5-a96a-53ccc90805ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c1cd6-c5eb-4375-a766-77ca6bd1b4fc", "name": "network-vif-plugged", "status": "completed", "tag": "6f067b2c-582f-4229-80f1-49f8804249fb"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:16.212529 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-53c55f28-5607-4b14-b1fb-56d7ee45987d req-8990192d-74ab-42e5-a96a-53ccc90805ed service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:16.212944 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-53c55f28-5607-4b14-b1fb-56d7ee45987d req-8990192d-74ab-42e5-a96a-53ccc90805ed service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:16.230385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-53c55f28-5607-4b14-b1fb-56d7ee45987d req-8990192d-74ab-42e5-a96a-53ccc90805ed service nova] Creating event network-vif-plugged:6f067b2c-582f-4229-80f1-49f8804249fb for instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc on hv-cinder-84414 Jun 06 14:27:16.236826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-53c55f28-5607-4b14-b1fb-56d7ee45987d req-8990192d-74ab-42e5-a96a-53ccc90805ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041420 Jun 06 14:27:16.237671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 303/646] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:16.453739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:16.454726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:16.461597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:16.462143 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:16.462926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:16.463360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:16.493268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lazy-loading 'flavor' on Instance uuid 50386bc4-52ea-44da-834e-381f38cc47c3 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:27:16.606993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:16.655102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a53802c-61e3-45ff-a0db-cdf469b912d6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/action" status: 200 len: 32 microversion: 2.1 time: 0.206080 Jun 06 14:27:16.655940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 344/647] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:27:16 2022] POST /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:27:16.666374 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:16.667078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:16.675174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:16.675625 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:16.676501 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:16.676918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:16.863614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:16.876656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-77ba9f95-41cd-4115-aecd-67aa6bedc61e tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.213364 Jun 06 14:27:16.876656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 304/648] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:16 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:17.099133 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:17.099952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:17.107075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:17.107528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:17.109194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:17.109658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:17.297882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:17.307448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0cb2fdbc-c8fb-4438-88fa-8b7897d3cc68 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1368 microversion: 2.1 time: 0.214285 Jun 06 14:27:17.308026 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 345/649] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:17 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:17.896405 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:17.897211 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:17.903760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:17.904202 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:17.904979 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:17.905486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.057255 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:18.072398 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-18686c4c-16ed-448a-a093-ef5fca836c69 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.180021 Jun 06 14:27:18.073001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 305/650] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:17 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:18.131825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:18.132461 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:18.139367 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.139849 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.140854 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.141299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.176549 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d79b8d1e-9b97-46c3-8343-8390c2e3b2f0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments/4e28a322-2022-43f4-9dd1-e9603346a114" status: 200 len: 194 microversion: 2.20 time: 0.048793 Jun 06 14:27:18.179058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 346/651] 10.222.0.13 () {60 vars in 1453 bytes} [Mon Jun 6 14:27:18 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments/4e28a322-2022-43f4-9dd1-e9603346a114 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:27:18.280013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:18.281180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:18.288090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.288636 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.289483 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.290039 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.316586 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:18.324883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:18.326661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:18.333502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.334002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.334846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.335291 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.443474 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lazy-loading 'services' on Instance uuid d12d1c93-4204-4b5b-ab25-22a197f92d27 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:27:18.545087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:18.559710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1c6de10a-dec6-463b-8634-db7f89f0ed2e tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1558 microversion: 2.1 time: 0.238541 Jun 06 14:27:18.560832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 347/652] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:18 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:18.566499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-52aafc2e-0b2c-475a-b6b4-e709157b954d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments/4e28a322-2022-43f4-9dd1-e9603346a114" status: 202 len: 0 microversion: 2.20 time: 0.290150 Jun 06 14:27:18.567452 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 306/653] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jun 6 14:27:18 2022] DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments/4e28a322-2022-43f4-9dd1-e9603346a114 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:27:18.578906 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:18.580207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:18.584981 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:18.586833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:18.588496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.589155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.591058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.591844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.601132 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.602775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.605399 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:18.606369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:18.646820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-68b9181e-5316-4c0f-b549-c0ce982143f8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072007 Jun 06 14:27:18.653873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 348/654] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 14:27:18 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 14:27:18.721301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-93fb5950-8811-46af-86d6-c5bbf8f13924 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145037 Jun 06 14:27:18.721961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 307/655] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:27:18 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:19.093412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:19.094790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:19.106692 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:19.107991 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:19.110457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:19.111576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:19.614168 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:19.643111 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4c3f8827-70c1-4547-a3ce-171ec7333ecd tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.554834 Jun 06 14:27:19.659753 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 349/656] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:19 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:19.663465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:19.664719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:19.677985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:19.678796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:19.680545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:19.681514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:19.740972 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e121159c-f3ad-4b30-996b-879666bb41e2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082939 Jun 06 14:27:19.742611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 308/657] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 14:27:19 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:19.820509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:19.821132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:19.829098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:19.829982 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:19.831264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:19.831873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:19.864668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:27:19.988255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7c844897-0570-49f4-b237-9bc4afb78079 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 204 len: 0 microversion: 2.20 time: 0.170872 Jun 06 14:27:19.993598 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 350/658] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 14:27:19 2022] DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 14:27:20.003409 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:20.004700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:20.017197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:20.018056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:20.019456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:20.020241 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:20.471119 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:20.483339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:20.486628 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:20.488560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bb627c6f-100a-4569-bf35-e8f0147fc33a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.493583 Jun 06 14:27:20.489465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 309/659] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:19 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:20.682930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:20.684158 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:20.696118 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:20.696917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:20.698357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:20.699407 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:20.791108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-d1bc0117-568e-4ebe-b4f9-c6ce7642b68b req-1df2ca39-e663-4f11-8a07-0c2ce26973d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384c1cd6-c5eb-4375-a766-77ca6bd1b4fc", "tag": "6f067b2c-582f-4229-80f1-49f8804249fb"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:20.807708 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d1bc0117-568e-4ebe-b4f9-c6ce7642b68b req-1df2ca39-e663-4f11-8a07-0c2ce26973d4 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:20.809098 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d1bc0117-568e-4ebe-b4f9-c6ce7642b68b req-1df2ca39-e663-4f11-8a07-0c2ce26973d4 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:20.830517 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-d1bc0117-568e-4ebe-b4f9-c6ce7642b68b req-1df2ca39-e663-4f11-8a07-0c2ce26973d4 service nova] Creating event network-changed:6f067b2c-582f-4229-80f1-49f8804249fb for instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc on hv-cinder-84414 Jun 06 14:27:20.839418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-d1bc0117-568e-4ebe-b4f9-c6ce7642b68b req-1df2ca39-e663-4f11-8a07-0c2ce26973d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051902 Jun 06 14:27:20.841904 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 310/660] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:20.978571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:20.992789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e388fb8d-2b07-42d2-affb-4ebea2d5e270 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.323117 Jun 06 14:27:20.993605 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 351/661] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:20 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:21.513358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:21.514258 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:21.527035 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:21.527955 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:21.529236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:21.530077 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:21.820986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:21.831889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:21.833568 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:21.834834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-001ac171-bddc-4d13-ad15-f1e4dcbed5b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.325739 Jun 06 14:27:21.835403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 311/662] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:21 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:22.017914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:22.020211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:22.033973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:22.034799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:22.036253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:22.037007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:22.269265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:22.287456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cbe0d70c-7666-4a7e-9934-84a5e67cbb88 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.279473 Jun 06 14:27:22.304267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 352/663] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:22 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:22.866331 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:22.867251 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:22.875785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:22.876249 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:22.877061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:22.877492 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:23.063126 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:23.080199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:23.083561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:23.086516 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aa7cc1b8-1597-4a12-b38f-37cccfa5d91e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1724 microversion: 2.20 time: 0.225027 Jun 06 14:27:23.089736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 312/664] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:22 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:23.314826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:23.315979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:23.325743 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:23.326442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:23.328079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:23.329082 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:23.601754 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:23.612667 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-583cea75-ec6b-4e30-b8f2-85a3a83dc6e2 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.303477 Jun 06 14:27:23.617923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 353/665] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:23 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:23.988175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-46f155cd-f76b-4030-9886-9201f67b4e63 req-19f006e4-9c3d-4523-9b5a-86f3ad9aace4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12d1c93-4204-4b5b-ab25-22a197f92d27", "name": "network-vif-deleted", "tag": "d0b62115-c8dd-481f-97e8-5204944b431a"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:24.009363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-46f155cd-f76b-4030-9886-9201f67b4e63 req-19f006e4-9c3d-4523-9b5a-86f3ad9aace4 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:24.011929 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-46f155cd-f76b-4030-9886-9201f67b4e63 req-19f006e4-9c3d-4523-9b5a-86f3ad9aace4 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:24.040267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-46f155cd-f76b-4030-9886-9201f67b4e63 req-19f006e4-9c3d-4523-9b5a-86f3ad9aace4 service nova] Creating event network-vif-deleted:d0b62115-c8dd-481f-97e8-5204944b431a for instance d12d1c93-4204-4b5b-ab25-22a197f92d27 on hv-cinder-84414 Jun 06 14:27:24.050991 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-46f155cd-f76b-4030-9886-9201f67b4e63 req-19f006e4-9c3d-4523-9b5a-86f3ad9aace4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067559 Jun 06 14:27:24.051892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 313/666] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:24.126964 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:24.131283 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:24.158445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:24.159295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:24.160197 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:24.160695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:24.227492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:24.227956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:24.228429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lazy-loading 'fault' on Instance uuid d12d1c93-4204-4b5b-ab25-22a197f92d27 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:27:24.321330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:24.334570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:24.336811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:24.338788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-660ce5e5-c3d1-471f-baa6-fce382cf9851 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 200 len: 1372 microversion: 2.20 time: 0.225232 Jun 06 14:27:24.339956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 354/667] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:24 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:24.640072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:24.640787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:24.668620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:24.670071 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:24.675201 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:24.676700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:25.014883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:25.050278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f8177ced-2236-4032-8f38-823f8f9be2e8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.414480 Jun 06 14:27:25.058423 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 314/668] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:24 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:25.367072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:25.368206 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:25.381241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:25.381955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:25.383496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:25.384045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:25.412876 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] HTTP exception thrown: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Request method failure captured: Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 HTTP/1.1 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2uDqsI-I4RyEAvYwvjfPgG6pzD3e0ISHq4ZGFxorsLUJ3RJ4SslxOmYa79fAfQPqZUjW9aCp1pGco8nRl_PVusxrJ63yBBuVR_cvwzJ4Mv1GnCtU4a9Rq4cYCXcNHSPgr7HL8Z1yGt_0hhzTQcTpwIQHFsyfidP96kadowNT8I36U Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:27:25.416436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52da965db3654006abddd5b40b0905c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52da965db3654006abddd5b40b0905c2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}] Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 405ac2f6c07545efaa818e10fc788c05 Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:27:25.418304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'd12d1c93-4204-4b5b-ab25-22a197f92d27'} Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:27:25.419623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:27:25.423683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:25.426167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Returning 404 to user: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:27:25.426167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-eaf2b05d-6ea6-48c2-972b-c64b5c4b577e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 404 len: 111 microversion: 2.20 time: 0.058568 Jun 06 14:27:25.426167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 355/669] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:25 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 14:27:25.434582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e2b7fde4-540d-4ca3-b185-8900a62abd81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '.version_select at 0x7fae940f34c0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:25.484367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e2b7fde4-540d-4ca3-b185-8900a62abd81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502505927" status: 204 len: 0 microversion: 2.20 time: 0.055200 Jun 06 14:27:25.488615 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 315/670] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Jun 6 14:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502505927 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 14:27:26.075567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:26.076603 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:26.081259 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:26.096253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:26.103753 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:26.105137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:26.111967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:26.666819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:26.692793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-67ae46ec-8da1-436f-acd0-88bb82e7d2be tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.621697 Jun 06 14:27:26.695208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 356/671] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:26 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:26.942623 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-75a5e6df-b7df-47aa-ab34-4209c89de550 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'create', calling method: .version_select at 0x7fae9414a430>, body: {"keypair": {"name": "tempest-keypair-590478536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiWuvGxsZSD788c0mb1EFI5yjYicq+NBD+rqcjqjuAPECUdbKQKQLbrbzUXz2PHRf65QnGh3bm0nAFOJ1LeQWzzF5BnLY3VpQeFngQKQv4+iLfuXd3RMqZL4rg8L0r+TQ=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:26.970078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-75a5e6df-b7df-47aa-ab34-4209c89de550 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for project 52da965db3654006abddd5b40b0905c2. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:26.981308 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-75a5e6df-b7df-47aa-ab34-4209c89de550 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for user 405ac2f6c07545efaa818e10fc788c05 and project 52da965db3654006abddd5b40b0905c2. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:27.038458 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-75a5e6df-b7df-47aa-ab34-4209c89de550 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.102289 Jun 06 14:27:27.041803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 316/672] 10.222.0.13 () {62 vars in 1199 bytes} [Mon Jun 6 14:27:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 14:27:27.738040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:27.742787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:27.772868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:27.774330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:27.776947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:27.778179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:28.075450 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:28.120829 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9491b08a-371a-4015-853b-3205f082ffc8 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.408609 Jun 06 14:27:28.124081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 357/673] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:27 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:29.142440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:29.143331 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:29.152300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:29.158471 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:29.160158 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:29.160864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:29.398252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:29.414375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b205b6df-b701-4d4e-a782-bf8dcb263520 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.277239 Jun 06 14:27:29.416143 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 317/674] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:29 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:30.151531 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2071998132", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b65619dd-abf2-4bc8-afc9-54a8502ba090"}], "security_groups": [{"name": "tempest-securitygroup--1818588643"}], "key_name": "tempest-keypair-590478536", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:30.321314 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] validate_networks() for [('b65619dd-abf2-4bc8-afc9-54a8502ba090', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:27:30.440819 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:30.442094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:30.456691 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:30.457498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:30.458981 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:30.459767 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:30.802110 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:30.823609 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f5a28dfb-e29f-4179-aff6-fa025210b861 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1735 microversion: 2.1 time: 0.389507 Jun 06 14:27:30.825124 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 318/675] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:30 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1735 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:31.001374 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:27:31.002427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:27:31.003445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:27:31.004318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:27:31.005120 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:27:31.027710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:31.028643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:31.030246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:31.031134 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:31.070182 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for project 52da965db3654006abddd5b40b0905c2. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:31.079263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Getting quotas for user 405ac2f6c07545efaa818e10fc788c05 and project 52da965db3654006abddd5b40b0905c2. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:31.111647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:27:31.120377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:27:31.237988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9bbf45b7-a3b6-4eb3-8132-84c1a1262e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.090144 Jun 06 14:27:31.242688 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 358/676] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jun 6 14:27:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 14:27:31.258751 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f040e714-36ab-4386-a285-d0d49b48bf2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:31.259787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f040e714-36ab-4386-a285-d0d49b48bf2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:31.352376 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f040e714-36ab-4386-a285-d0d49b48bf2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:31.362725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f040e714-36ab-4386-a285-d0d49b48bf2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:31.364382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f040e714-36ab-4386-a285-d0d49b48bf2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:31.365577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f040e714-36ab-4386-a285-d0d49b48bf2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1281 microversion: 2.20 time: 0.114082 Jun 06 14:27:31.366191 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 319/677] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:31 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:31.847569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:31.848995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:31.871255 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:31.876352 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:31.877840 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:31.878665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:32.302783 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:32.321087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:32.329386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-92854d10-c686-4212-80e7-459154267591 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1715 microversion: 2.1 time: 0.488687 Jun 06 14:27:32.334807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 359/678] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:31 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1715 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:32.384493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-534fc460-ed44-40c0-ba9d-a1fcfa600e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:32.385881 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-534fc460-ed44-40c0-ba9d-a1fcfa600e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:32.490276 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-534fc460-ed44-40c0-ba9d-a1fcfa600e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:32.505693 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-534fc460-ed44-40c0-ba9d-a1fcfa600e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:32.509561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-534fc460-ed44-40c0-ba9d-a1fcfa600e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:32.512102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-534fc460-ed44-40c0-ba9d-a1fcfa600e6e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1281 microversion: 2.20 time: 0.131318 Jun 06 14:27:32.513885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 320/679] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:32 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1281 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:32.595915 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:32.596506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:32.605556 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:32.606132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:32.607221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:32.608888 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:32.784524 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] HTTP exception thrown: Cannot 'detach_volume' instance 50386bc4-52ea-44da-834e-381f38cc47c3 while it is in vm_state rescued Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Request method failure captured: Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments/ba13b314-cf0a-4720-a234-bdba83359006 HTTP/1.1 Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing26LYqRK8mDvncmOjod4lEogL9ReU4MHXEE4Cd1AWDJgdZbamX_Nz8dmwL9DkSO8vD0b4fdm8sCryBJV9nj5P4Kd_wWgZ_2KKDlhoOCRZH9zyQgcusKXTa162H1DuVz3xLUYN_YX4lvBlS5SUyMdwKuAK9Q1dXYNNBlzPYoxGjOLbc Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:27:32.788392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5e2e414f37bf4a89ac18e1836c793b0b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}] Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 86f9bcac527c45d6bc81b70e26544924 Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:27:32.791388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Cannot 'detach_volume' instance 50386bc4-52ea-44da-834e-381f38cc47c3 while it is in vm_state rescued Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': '50386bc4-52ea-44da-834e-381f38cc47c3', 'id': 'ba13b314-cf0a-4720-a234-bdba83359006'} Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:27:32.792917 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 50386bc4-52ea-44da-834e-381f38cc47c3 while it is in vm_state rescued Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 50386bc4-52ea-44da-834e-381f38cc47c3 while it is in vm_state rescued Jun 06 14:27:32.795387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:32.801230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Returning 409 to user: Cannot 'detach_volume' instance 50386bc4-52ea-44da-834e-381f38cc47c3 while it is in vm_state rescued {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:27:32.803350 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f9c7188f-ec07-40ac-b0e5-82a44060d022 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments/ba13b314-cf0a-4720-a234-bdba83359006" status: 409 len: 152 microversion: 2.1 time: 0.213527 Jun 06 14:27:32.804730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 360/680] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:27:32 2022] DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments/ba13b314-cf0a-4720-a234-bdba83359006 => generated 152 bytes in 216 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 14:27:32.815899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:32.816448 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:32.835841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:32.836426 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:32.837541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:32.848302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:32.976605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2528d91d-8059-4cac-aede-efa7a2b4a335 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "POST /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/action" status: 202 len: 0 microversion: 2.1 time: 0.162224 Jun 06 14:27:32.978173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 321/681] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:27:32 2022] POST /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:27:32.991542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:32.992494 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:33.003099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:33.003863 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:33.005100 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:33.005844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:33.286563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:33.324410 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b7b53bff-9a72-4ab4-8317-36c1b6388365 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1723 microversion: 2.1 time: 0.338617 Jun 06 14:27:33.333690 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 361/682] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:32 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:33.544059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:33.549973 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:33.582896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:33.588971 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:33.591045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:33.599488 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:33.759283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:33.787937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:33.793129 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:33.796988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8b5d11ba-7c8a-4541-bc5e-87e421eb554d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1341 microversion: 2.20 time: 0.266006 Jun 06 14:27:33.802748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 322/683] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:33 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1341 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:34.362383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:34.363948 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:34.378705 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:34.379575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:34.381102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:34.381733 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:34.837059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:34.842886 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:34.870086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:34.870703 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:34.876835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:34.877630 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:35.441888 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:35.457937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:35.463010 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:35.466278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ae6307e9-5ebd-46df-82c0-74de596b5838 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 0.638401 Jun 06 14:27:35.470398 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 323/684] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:34 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:35.553965 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:35.570530 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cd6e77b5-a49e-4f0d-a888-a3b9ab6b0ac6 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1723 microversion: 2.1 time: 1.218349 Jun 06 14:27:35.572437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 362/685] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:34 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1723 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:36.509364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:36.510646 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:36.534136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:36.534603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:36.535439 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:36.535885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:36.606903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:36.609593 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:36.635694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:36.636087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:36.636882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:36.637337 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:37.216464 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:37.245767 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:37.256511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:37.265405 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-24fda007-f637-48b6-bc26-6d3123a5b6f5 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 0.768431 Jun 06 14:27:37.270350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 324/686] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:36 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:37.313024 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:37.345260 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0d265bbe-1d5b-42b5-b5ee-6aa3ce1a4b1f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1723 microversion: 2.1 time: 0.757096 Jun 06 14:27:37.350886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 363/687] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:36 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1723 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:38.301593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:38.302691 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:38.323698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.324681 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.325593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.326610 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.376869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:38.377821 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:38.391374 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.391837 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.392667 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.393109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.772048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:38.820029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:38.823774 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:38.826092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dad5a8a4-3b82-4dfa-828b-4d7cef7dee4b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 0.528119 Jun 06 14:27:38.841338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:38.843433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 325/688] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:38 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:38.865288 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0442e127-d7e3-4be8-81b6-12fe667ce060 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1729 microversion: 2.1 time: 0.493193 Jun 06 14:27:38.875046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 364/689] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:38 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1729 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:38.882608 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-2916fe91-4b79-4e39-8287-77a1bb8aaeca req-ba766a1d-0c47-4064-80d6-182736334aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:38.896141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2916fe91-4b79-4e39-8287-77a1bb8aaeca req-ba766a1d-0c47-4064-80d6-182736334aeb service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.897303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2916fe91-4b79-4e39-8287-77a1bb8aaeca req-ba766a1d-0c47-4064-80d6-182736334aeb service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.907113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:38.908284 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:38.926814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.927924 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.932280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:38.933139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:38.948130 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-2916fe91-4b79-4e39-8287-77a1bb8aaeca req-ba766a1d-0c47-4064-80d6-182736334aeb service nova] Creating event network-changed:00be5767-88c2-478d-a1ae-cc4eac3793c2 for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a on hv-cinder-84414 Jun 06 14:27:38.958426 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-2916fe91-4b79-4e39-8287-77a1bb8aaeca req-ba766a1d-0c47-4064-80d6-182736334aeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113327 Jun 06 14:27:38.970778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 326/690] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:39.151438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4859a1ff-9f24-4faf-baa2-7307d80b9d2b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.252577 Jun 06 14:27:39.152037 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 365/691] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:27:38 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:40.281459 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:40.290078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:40.339970 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:40.340757 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:40.342794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:40.348107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:40.733156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ee49ce60-d73b-4963-beeb-154baa74ca75 req-67e50f58-872c-4154-8aae-d0f98e668045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50386bc4-52ea-44da-834e-381f38cc47c3", "tag": "df54d3c7-86bf-4c37-ba45-0d8672392f1d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:40.762725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ee49ce60-d73b-4963-beeb-154baa74ca75 req-67e50f58-872c-4154-8aae-d0f98e668045 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:40.764009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ee49ce60-d73b-4963-beeb-154baa74ca75 req-67e50f58-872c-4154-8aae-d0f98e668045 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:40.798487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ee49ce60-d73b-4963-beeb-154baa74ca75 req-67e50f58-872c-4154-8aae-d0f98e668045 service nova] Creating event network-changed:df54d3c7-86bf-4c37-ba45-0d8672392f1d for instance 50386bc4-52ea-44da-834e-381f38cc47c3 on hv-cinder-84414 Jun 06 14:27:40.815108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ee49ce60-d73b-4963-beeb-154baa74ca75 req-67e50f58-872c-4154-8aae-d0f98e668045 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087123 Jun 06 14:27:40.815730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 366/692] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:40.852699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:40.880540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:40.891786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:40.899316 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:40.900537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2bf86e41-eb45-4f10-bb76-40fe7017f21a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 1.043834 Jun 06 14:27:40.920933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 327/693] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:39 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:41.074830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:41.084397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:41.085989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:41.093325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=6 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:41.097851 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.100142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.102799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.104212 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.174682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-eff083e3-4e84-47c5-af2b-e5cc049952c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100807 Jun 06 14:27:41.197833 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 367/694] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:27:41 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:27:41.258038 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:41.258946 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:41.272485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.275807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.277045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.277746 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.373699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:27:41.565472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7459604c-7bdf-49d6-83d0-9eae1596ea5e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 204 len: 0 microversion: 2.1 time: 0.307565 Jun 06 14:27:41.567846 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 328/695] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:27:41 2022] DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:27:41.580910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:41.581727 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:41.589959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.590882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.592596 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.593881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.859705 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:41.882146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8efe8bcd-f2ad-4adf-b599-7c715224c2c0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1675 microversion: 2.1 time: 0.307524 Jun 06 14:27:41.884923 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 368/696] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:41 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1675 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:41.921498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:41.922652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:41.926703 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:41.932909 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.933696 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:41.936514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:41.937883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:42.215906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:42.229420 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:42.233945 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:42.236561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-025755a7-dabc-456f-80e7-3140580f8c2a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 0.319660 Jun 06 14:27:42.248949 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 329/697] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:41 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:42.899500 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=8 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:42.907832 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:42.908496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:42.942997 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:42.944152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:42.947321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:42.950740 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:43.054891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-6c540d70-8097-4467-ad74-424eeb70c0c8 req-ce079008-5034-4e8f-aab8-2bb1724f66ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50386bc4-52ea-44da-834e-381f38cc47c3", "tag": "df54d3c7-86bf-4c37-ba45-0d8672392f1d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:43.066940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-6c540d70-8097-4467-ad74-424eeb70c0c8 req-ce079008-5034-4e8f-aab8-2bb1724f66ec service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:43.067395 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-6c540d70-8097-4467-ad74-424eeb70c0c8 req-ce079008-5034-4e8f-aab8-2bb1724f66ec service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:43.109687 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-6c540d70-8097-4467-ad74-424eeb70c0c8 req-ce079008-5034-4e8f-aab8-2bb1724f66ec service nova] Creating event network-changed:df54d3c7-86bf-4c37-ba45-0d8672392f1d for instance 50386bc4-52ea-44da-834e-381f38cc47c3 on hv-cinder-84414 Jun 06 14:27:43.119645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-6c540d70-8097-4467-ad74-424eeb70c0c8 req-ce079008-5034-4e8f-aab8-2bb1724f66ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266854 Jun 06 14:27:43.125891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 369/698] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:43.263262 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:43.272784 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:43.296785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:43.297493 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:43.298841 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:43.299668 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:43.364607 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:43.407567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-462e2bb1-9b9e-42be-be3a-2d4fd4adb705 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1675 microversion: 2.1 time: 0.508291 Jun 06 14:27:43.408613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 330/699] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:42 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1675 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:44.426197 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:44.431799 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:44.433071 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:44.458760 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:44.463023 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:44.465414 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6838c63e-2b0c-4598-9ef3-3da9e5214692 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 1.209495 Jun 06 14:27:44.465914 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:44.466732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:44.467423 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 370/700] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:43 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:44.468135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:44.468880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:45.447494 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:45.504465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a3e35171-1d25-4fad-ac10-736b2ad23b71 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1675 microversion: 2.1 time: 1.080682 Jun 06 14:27:45.513997 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 331/701] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:44 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1675 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:45.540578 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:45.541635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:45.584160 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:45.586851 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:45.587768 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:45.590989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:45.988685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:46.015881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:46.020442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:46.023641 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8a75c56f-2858-4354-9bfb-90d996a46f84 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 0.525878 Jun 06 14:27:46.025744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 371/702] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:45 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:46.553692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:46.563835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:46.603946 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:46.605690 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:46.608154 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:46.609330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:46.696435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-9e4c7052-244f-44b1-862c-d193dd96017f req-9e2eaabe-4535-457d-9f7b-cdc0e6757e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "name": "network-vif-plugged", "status": "completed", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:46.712867 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-9e4c7052-244f-44b1-862c-d193dd96017f req-9e2eaabe-4535-457d-9f7b-cdc0e6757e34 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:46.713327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-9e4c7052-244f-44b1-862c-d193dd96017f req-9e2eaabe-4535-457d-9f7b-cdc0e6757e34 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:46.744221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-9e4c7052-244f-44b1-862c-d193dd96017f req-9e2eaabe-4535-457d-9f7b-cdc0e6757e34 service nova] Creating event network-vif-plugged:00be5767-88c2-478d-a1ae-cc4eac3793c2 for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a on hv-cinder-84414 Jun 06 14:27:46.756343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-9e4c7052-244f-44b1-862c-d193dd96017f req-9e2eaabe-4535-457d-9f7b-cdc0e6757e34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066473 Jun 06 14:27:46.759137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 372/703] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:47.011235 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:47.028288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-319a52b1-f579-42b3-a047-f4ae4e3d73a0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1608 microversion: 2.1 time: 0.484226 Jun 06 14:27:47.030835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 332/704] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:46 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1608 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:47.048163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:47.049393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:47.066369 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:47.067167 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:47.072033 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:47.072685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:47.360898 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-aa109118-594c-44fa-81a0-521bb763e363 req-1d5ae556-3c4c-4467-9db3-03e6cebe5f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9070a8fe-f081-4116-9cf2-81094e156184", "name": "network-vif-deleted", "tag": "e7fe91d4-1dec-4926-a1d7-5016c675e5d8"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:47.382122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-aa109118-594c-44fa-81a0-521bb763e363 req-1d5ae556-3c4c-4467-9db3-03e6cebe5f11 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:47.383503 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-aa109118-594c-44fa-81a0-521bb763e363 req-1d5ae556-3c4c-4467-9db3-03e6cebe5f11 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:47.420976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-aa109118-594c-44fa-81a0-521bb763e363 req-1d5ae556-3c4c-4467-9db3-03e6cebe5f11 service nova] Creating event network-vif-deleted:e7fe91d4-1dec-4926-a1d7-5016c675e5d8 for instance 9070a8fe-f081-4116-9cf2-81094e156184 on hv-cinder-84414 Jun 06 14:27:47.435157 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-aa109118-594c-44fa-81a0-521bb763e363 req-1d5ae556-3c4c-4467-9db3-03e6cebe5f11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079022 Jun 06 14:27:47.437445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 333/705] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:47.489328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:47.502092 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:47.504166 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:47.505873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-119535f0-42e1-40f3-808f-3bbe9bc1de25 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1407 microversion: 2.20 time: 0.464042 Jun 06 14:27:47.522787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 373/706] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:47 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1407 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:48.050450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:48.051886 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:48.059645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.060535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:48.061396 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.061860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:48.136883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.137332 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:48.138162 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lazy-loading 'fault' on Instance uuid 9070a8fe-f081-4116-9cf2-81094e156184 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:27:48.197951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:48.211263 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e300759c-e0a7-4fb1-a690-a9b945aae6b4 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 200 len: 1328 microversion: 2.1 time: 0.167398 Jun 06 14:27:48.212063 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 334/707] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:48 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 1328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:48.536698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:48.546451 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:48.572788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.573961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:48.575575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.577116 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:48.775959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:48.787785 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:48.789869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:48.791787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fd6c7ae0-0d95-4925-8702-36ea62ed5aec tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1598 microversion: 2.20 time: 0.262561 Jun 06 14:27:48.792596 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 374/708] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:27:48 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1598 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:27:48.854467 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:48.855347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:48.881059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.890395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:48.892441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:48.898144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:49.089857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3727c452-e709-454d-b9c8-d6abbc3c2423 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.281460 Jun 06 14:27:49.099477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 335/709] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jun 6 14:27:48 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-interface => generated 284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:27:49.228801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:49.230079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:49.239674 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:49.240441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:49.241498 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:49.242260 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:49.258970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] HTTP exception thrown: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Request method failure captured: Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 HTTP/1.1 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2vH9sXMgnwFAp1rHjb6T0-nCT1PBhlYy8qEzbjDwWbkQM9paAf2dcPpQnNkUkVzSTYTStFu6UQk5ncxUoyIsUJxdD3XKBSRHuZfVf3PNtRsgxXphcQIUl7WQPZQbxUEAG7QU-UTyRG0RM7Ug_5F_mgBZmcMv8Ph3mfnWEW7zf7ah4 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:27:49.261097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c41996fbf4ab4b81bc47ac29252ec762", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}] Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 3f2e1c5d022c4bde9e76b8a933739557 Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:27:49.262561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '9070a8fe-f081-4116-9cf2-81094e156184'} Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:27:49.263443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:27:49.265766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:27:49.269409 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Returning 404 to user: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:27:49.270598 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cac681bf-ba2b-46a2-b237-85ab4080a65c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 404 len: 111 microversion: 2.1 time: 0.045991 Jun 06 14:27:49.271292 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 375/710] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:49 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:27:49.280875 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-56b42c60-69ee-4b3e-8d56-2076fd65b527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '.version_select at 0x7fae9408f700>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:49.316505 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-56b42c60-69ee-4b3e-8d56-2076fd65b527 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114144127" status: 202 len: 0 microversion: 2.1 time: 0.033796 Jun 06 14:27:49.319087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 336/711] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 14:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114144127 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:27:50.444370 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-55191ddc-8adf-4838-a4c9-70ea0075cc81 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: .version_select at 0x7fae8a5ed310>, body: {"keypair": {"name": "tempest-keypair-1196715169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHZLEp0sYyZEHdRPztXHQIun7bLUfMxhIckmFBQdGSR3KhyQtgn8cLk6EmW8pOR9O7x4Bl6+WeRSj21YwlbXT37qxOfPtM5ZYn/0/d5PwlAPuUVtceTqIQ9hXlPPavJ7Q=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:50.466504 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-55191ddc-8adf-4838-a4c9-70ea0075cc81 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:50.474560 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-55191ddc-8adf-4838-a4c9-70ea0075cc81 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for user 3f2e1c5d022c4bde9e76b8a933739557 and project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:50.527766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-55191ddc-8adf-4838-a4c9-70ea0075cc81 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087325 Jun 06 14:27:50.542275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 376/712] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:27:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:50.762631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-be05e44c-2eba-4c2b-abb7-e78ace43205b req-0000ae54-1072-4d30-a89a-b78b37644ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:50.782434 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-be05e44c-2eba-4c2b-abb7-e78ace43205b req-0000ae54-1072-4d30-a89a-b78b37644ddd service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:50.796842 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-be05e44c-2eba-4c2b-abb7-e78ace43205b req-0000ae54-1072-4d30-a89a-b78b37644ddd service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:50.838839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-be05e44c-2eba-4c2b-abb7-e78ace43205b req-0000ae54-1072-4d30-a89a-b78b37644ddd service nova] Creating event network-changed:00be5767-88c2-478d-a1ae-cc4eac3793c2 for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a on hv-cinder-84414 Jun 06 14:27:50.852525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-be05e44c-2eba-4c2b-abb7-e78ace43205b req-0000ae54-1072-4d30-a89a-b78b37644ddd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094116 Jun 06 14:27:50.858748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 337/713] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:27:53.333521 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-838600976", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8a2e4ba-03d2-4744-85c7-3c6508d2bd9d"}], "security_groups": [{"name": "tempest-securitygroup--1529795248"}], "key_name": "tempest-keypair-1196715169", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:53.625264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] validate_networks() for [('e8a2e4ba-03d2-4744-85c7-3c6508d2bd9d', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:27:54.534301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:27:54.536973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:27:54.540626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:27:54.541895 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:27:54.542811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:27:54.567154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:54.568984 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:54.570830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:54.573829 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:54.614546 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:54.624336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Getting quotas for user 3f2e1c5d022c4bde9e76b8a933739557 and project c41996fbf4ab4b81bc47ac29252ec762. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:54.653293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:27:54.658286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:27:54.759581 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1cced6ce-a582-4a71-af88-8a190aa68e4f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.434975 Jun 06 14:27:54.770152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 377/714] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:27:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 14:27:54.780708 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-48136a04-5f5e-4871-914f-d9480ced3690 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:54.786815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-48136a04-5f5e-4871-914f-d9480ced3690 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:54.952128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-48136a04-5f5e-4871-914f-d9480ced3690 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:54.965822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-48136a04-5f5e-4871-914f-d9480ced3690 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1237 microversion: 2.1 time: 0.193563 Jun 06 14:27:54.977759 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 338/715] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:54 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1237 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:55.991507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:55.992466 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:56.001678 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:56.002314 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:56.003452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:56.004240 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:56.026549 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0ed7c6a0-78bc-4f67-b718-4a7fbc3b023d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Action: 'create', calling method: .version_select at 0x7fae940f39d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1050461738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpV0r2CUA72IapvkGo9cId/zB9LhZLgAEaBYuoYKIXxinQ2KwpTtdOL0cpizFaeZtC4t5RPcb5sKmg7Cr8S/dd4uW2Qnkr2RdFarReOLA/9WXbiVka6ws3FbSuqO3gz5w=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:56.047334 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-0ed7c6a0-78bc-4f67-b718-4a7fbc3b023d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Getting quotas for project d1af47083c644609a4a84b1273a4087f. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:56.052892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-0ed7c6a0-78bc-4f67-b718-4a7fbc3b023d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Getting quotas for user 791369c0e2574cdf8047a5f178a3c6db and project d1af47083c644609a4a84b1273a4087f. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:56.083345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0ed7c6a0-78bc-4f67-b718-4a7fbc3b023d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060822 Jun 06 14:27:56.083345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 339/716] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:27:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:56.094082 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:56.104274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-75185dad-f6f5-41de-a83d-ca28b9c5a8b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1289 microversion: 2.1 time: 0.117932 Jun 06 14:27:56.105620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 378/717] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:55 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:56.146538 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-123461855", "imageRef": "46f32d76-7224-4509-a647-f74de8c5b609", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1050461738", "networks": [{"uuid": "0bc8f27b-6227-41c2-afe6-78b098342e4c"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:56.233490 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] validate_networks() for [('0bc8f27b-6227-41c2-afe6-78b098342e4c', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:27:57.004347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:27:57.005032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:27:57.008274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:27:57.008274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:27:57.008274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:27:57.024021 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:57.025758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:57.025758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:57.026377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:57.058616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Getting quotas for project d1af47083c644609a4a84b1273a4087f. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:27:57.065556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Getting quotas for user 791369c0e2574cdf8047a5f178a3c6db and project d1af47083c644609a4a84b1273a4087f. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:27:57.082227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:27:57.084377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46f32d76-7224-4509-a647-f74de8c5b609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:27:57.123951 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:57.125512 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:57.129762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:57.134505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:57.135342 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:57.136432 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:57.137336 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:57.152450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-98f0bc17-8cf7-4296-8644-a583226596d2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014063 Jun 06 14:27:57.153792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 340/718] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:27:57.170175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ecbe1a87-3812-4b77-928c-0545c45ddbe7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:57.171235 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ecbe1a87-3812-4b77-928c-0545c45ddbe7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:57.345807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:57.354556 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9e8b4682-b846-4972-8468-654d6c7873ac tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1295 microversion: 2.1 time: 0.235089 Jun 06 14:27:57.358204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 379/719] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:57 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1295 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:27:57.392108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ecbe1a87-3812-4b77-928c-0545c45ddbe7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:57.399968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ecbe1a87-3812-4b77-928c-0545c45ddbe7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1258 microversion: 2.1 time: 0.237133 Jun 06 14:27:57.400701 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 341/720] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:57 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:57.766676 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:57.768258 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:57.780043 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:57.780807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:57.782443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:57.783235 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:57.850974 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-92cd5c79-49fd-4938-aa50-27211e5c995b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/ips" status: 200 len: 149 microversion: 2.1 time: 0.301204 Jun 06 14:27:57.858263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 380/721] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:27:57 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/ips => generated 149 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:58.379153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:58.381426 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:58.398797 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:58.399594 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:58.401364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:58.402196 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:58.427199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:58.428049 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:58.437080 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:58.437635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:58.438585 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:58.439152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:58.469479 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:27:58.663220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:58.688497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7fae7fa4-c2c1-4662-bb5a-00184e7feec9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1310 microversion: 2.1 time: 0.265949 Jun 06 14:27:58.690361 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 381/722] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:58 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:58.962297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:27:58.985933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d51e33b2-361d-485d-aa0a-6e216b668aaa tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.610065 Jun 06 14:27:59.001213 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 342/723] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:58 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:27:59.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-67659a1f-3374-4994-bf80-a8d50e83d001 req-ee3fbeba-1d1f-4722-b96d-1bd2e5d6ead3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad1d56f-357d-443c-a043-471ab99f59e6", "tag": "569a35d2-8e05-47d7-a517-e0725926092d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:59.134411 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-67659a1f-3374-4994-bf80-a8d50e83d001 req-ee3fbeba-1d1f-4722-b96d-1bd2e5d6ead3 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:59.134885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-67659a1f-3374-4994-bf80-a8d50e83d001 req-ee3fbeba-1d1f-4722-b96d-1bd2e5d6ead3 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:59.157281 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-67659a1f-3374-4994-bf80-a8d50e83d001 req-ee3fbeba-1d1f-4722-b96d-1bd2e5d6ead3 service nova] Creating event network-changed:569a35d2-8e05-47d7-a517-e0725926092d for instance 9ad1d56f-357d-443c-a043-471ab99f59e6 on hv-cinder-84414 Jun 06 14:27:59.181191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-67659a1f-3374-4994-bf80-a8d50e83d001 req-ee3fbeba-1d1f-4722-b96d-1bd2e5d6ead3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065556 Jun 06 14:27:59.182035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 382/724] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:27:59.439956 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43c008ec-3081-4c18-bbc8-fc9e5476c7a8"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:27:59.460386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:59.509299 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:59.510296 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:59.511817 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:59.521185 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:59.718761 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:27:59.719782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:27:59.751696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:59.753261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:27:59.754997 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:27:59.755730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:00.270735 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-35d95583-960e-4302-8c5a-836a0a375b04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841411 Jun 06 14:28:00.283960 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 343/725] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:27:59 2022] POST /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:00.357206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:00.358913 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:00.385528 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:00.389020 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:00.390937 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:00.392582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:00.968126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:01.004957 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a0eb767f-d2ae-4931-b4e2-be9579685165 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 1.287067 Jun 06 14:28:01.009803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 383/726] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:27:59 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:01.208434 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:01.233866 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b8f0c8e7-a562-4ebd-8391-356d6a48f30f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.948092 Jun 06 14:28:01.238551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 344/727] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:00 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:01.736137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-7747cff2-d139-408a-b1a2-3ffd8ee57578 req-d08e9ce0-9332-4c55-a2b3-6f1f0672e053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:01.774311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-7747cff2-d139-408a-b1a2-3ffd8ee57578 req-d08e9ce0-9332-4c55-a2b3-6f1f0672e053 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:01.781022 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-7747cff2-d139-408a-b1a2-3ffd8ee57578 req-d08e9ce0-9332-4c55-a2b3-6f1f0672e053 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:01.812752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-7747cff2-d139-408a-b1a2-3ffd8ee57578 req-d08e9ce0-9332-4c55-a2b3-6f1f0672e053 service nova] Creating event network-changed:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:28:01.835714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-7747cff2-d139-408a-b1a2-3ffd8ee57578 req-d08e9ce0-9332-4c55-a2b3-6f1f0672e053 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107029 Jun 06 14:28:01.837093 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 384/728] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:02.049303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:02.053762 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:02.095376 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:02.096590 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:02.100084 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:02.109260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:02.262224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:02.269941 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:02.285363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:02.287542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:02.290243 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:02.291491 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:02.820210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:02.835827 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:02.849071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f01c098b-0f7e-4f10-ac69-afee5dae43b7 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.596424 Jun 06 14:28:02.850064 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 385/729] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:02 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:02.861133 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-41ef76f0-1e3a-4351-82b0-f234fd9f27fb tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.825961 Jun 06 14:28:02.862967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 345/730] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:02 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:03.878423 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:03.879876 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:03.885317 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:03.887450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:03.889593 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:03.890233 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:03.891602 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:03.891907 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:03.905998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:03.907095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:03.908616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:03.909996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:04.227106 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:04.244283 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-807e5fd2-c076-4c33-a16c-acfe27cf2b17 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.372609 Jun 06 14:28:04.245628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 386/731] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:03 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:04.272237 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:04.288380 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b875fd19-10ee-42bf-89dc-08ed5c80403d tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.411716 Jun 06 14:28:04.289774 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 346/732] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:03 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:05.273667 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:05.275079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:05.280662 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:05.281916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=10 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:05.294911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:05.295936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:05.297384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:05.298677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:05.321101 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:05.323564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:05.338074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:05.339290 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:05.341002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:05.344865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:05.405104 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:05.691091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:05.720535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d668cc4f-13e4-4f49-b900-4f1eb9ccd50a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.453836 Jun 06 14:28:05.722598 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 387/733] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:05 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:05.750839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:05.772783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-52acd95f-9378-411e-b1e9-d91be7b5541a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.457234 Jun 06 14:28:05.775552 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 347/734] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:05 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:06.742788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:06.743780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:06.751128 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:06.751587 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:06.752395 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:06.752840 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:06.796180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:06.805927 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:06.815657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:06.816067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:06.817048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:06.817524 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:06.997578 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:07.013625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-20fe44b9-49ba-4391-8242-9f517deb4f75 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.277036 Jun 06 14:28:07.014890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 388/735] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:06 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:07.044449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:07.076775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:07.087455 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fc00fd8e-d51e-42b4-8bda-d55828a1982f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.296191 Jun 06 14:28:07.089778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 348/736] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:06 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:08.037967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:08.038814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:08.046834 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:08.047292 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:08.048105 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:08.048547 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:08.117303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:08.120582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:08.124716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=14 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:08.137516 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:08.138585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:08.139401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:08.139843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:08.300355 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:08.313091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e0c9017a-ffa8-4dd8-87f2-43552bc20f3a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.279584 Jun 06 14:28:08.314106 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 389/737] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:08 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:08.418634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:08.428329 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ea42c024-7496-4764-8365-c6427916e0c5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.315865 Jun 06 14:28:08.428936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 349/738] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:08 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:09.341453 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:09.342236 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:09.349151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:09.349608 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:09.350441 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:09.350883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:09.448658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:09.449788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:09.460141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:09.460768 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:09.462180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:09.462895 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:09.525140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:09.535643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f78dd8b3-9903-4d15-979c-e08319911450 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.198084 Jun 06 14:28:09.536357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 390/739] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:09 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:09.638417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:09.646467 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66b6b9de-4e9e-46c7-9f7c-ad473d5447bf tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.204530 Jun 06 14:28:09.647063 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 350/740] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:09 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:10.561542 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:10.563178 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:10.571513 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:10.571982 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:10.573035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:10.573664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:10.668025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:10.669670 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:10.681692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:10.682502 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:10.683854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:10.685338 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:10.776471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:10.785970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-972ab891-e01b-4aa5-8d35-82aba6cddc59 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.230731 Jun 06 14:28:10.786954 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 391/741] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:10 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:10.846477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:10.855757 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d11f8a3e-9af5-4215-bc68-5c464938bbff tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.194589 Jun 06 14:28:10.856617 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 351/742] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:10 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:11.814810 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:11.816885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:11.829679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:11.830713 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:11.832769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:11.833867 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:11.883975 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:11.884994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:11.898220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:11.898983 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:11.900334 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:11.901152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:12.045035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:12.063505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e1c30ba8-1df2-48ba-ad38-015c003822bd tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.256818 Jun 06 14:28:12.065611 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 392/743] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:11 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:12.299853 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:12.308161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d77a9b88-baf3-4a2d-90c3-a27133b0d119 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.432545 Jun 06 14:28:12.308757 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 352/744] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:11 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:12.660530 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43c008ec-3081-4c18-bbc8-fc9e5476c7a8"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:12.661757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:12.669016 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:12.669448 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:12.670445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:12.670934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:12.766557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Invalid volume: volume 43c008ec-3081-4c18-bbc8-fc9e5476c7a8 is already attached to instances: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments HTTP/1.1 Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 74 Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:28:12.768952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {"volumeAttachment": {"volumeId": "43c008ec-3081-4c18-bbc8-fc9e5476c7a8"}} Jun 06 14:28:12.771525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Invalid volume: volume 43c008ec-3081-4c18-bbc8-fc9e5476c7a8 is already attached to instances: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': '384c1cd6-c5eb-4375-a766-77ca6bd1b4fc', 'body': {'volumeAttachment': {'volumeId': '43c008ec-3081-4c18-bbc8-fc9e5476c7a8'}}} Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 43c008ec-3081-4c18-bbc8-fc9e5476c7a8 is already attached to instances: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:12.772832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 43c008ec-3081-4c18-bbc8-fc9e5476c7a8 is already attached to instances: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:12.774832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 43c008ec-3081-4c18-bbc8-fc9e5476c7a8 is already attached to instances: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 400 to user: Invalid volume: volume 43c008ec-3081-4c18-bbc8-fc9e5476c7a8 is already attached to instances: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a8033e3-8530-4116-993e-5b300a887d2d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114711 Jun 06 14:28:12.776830 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 393/745] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:28:12 2022] POST /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:28:12.844690 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:12.845189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:12.847236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:12.853369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:12.853861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:12.855028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:12.855465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:12.972512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'services' on Instance uuid 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:28:13.059425 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-343dc397-ff2f-40ac-91a5-c7c9aadf032b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments/43c008ec-3081-4c18-bbc8-fc9e5476c7a8" status: 202 len: 0 microversion: 2.1 time: 0.219302 Jun 06 14:28:13.063533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 353/746] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:28:12 2022] DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments/43c008ec-3081-4c18-bbc8-fc9e5476c7a8 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:28:13.073020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:13.073020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:13.083794 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:13.084252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:13.085107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:13.087045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:13.106582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:13.107864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:13.122852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:13.123676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:13.124994 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:13.125791 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:13.142089 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-728e6888-3fdf-4914-8af0-11ad47bed363 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074793 Jun 06 14:28:13.143008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 394/747] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:28:13 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:13.328936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:13.329364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:13.330160 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:13.337540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-75dacf56-fc0a-4453-8480-26649f794056 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.248921 Jun 06 14:28:13.338165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 354/748] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:13 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:13.341437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:13.342284 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:13.343764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:13.344559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:13.504703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:13.514516 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e8d3501d-2083-4908-90ca-0456e64f32e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.192480 Jun 06 14:28:13.515335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 395/749] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:13 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:14.157171 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:14.158211 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:14.165478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.165977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.166773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.167208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.202198 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-20cf80cc-4ffb-49dc-8fa1-a9f2e2e34548 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049671 Jun 06 14:28:14.202776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 355/750] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:28:14 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:14.358373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:14.359401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:14.367572 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.368031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.368878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.369315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.535295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:14.562269 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bdd4b97f-8480-43fc-85c9-56167368824f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.208676 Jun 06 14:28:14.570832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 396/751] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:14 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:14.578638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:14.579743 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:14.594798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-d92871db-d418-4b57-a150-c04cef44dfff req-c3ceb245-5367-4090-a7d3-bdf7bd4fba63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1d56f-357d-443c-a043-471ab99f59e6", "name": "network-vif-plugged", "status": "completed", "tag": "569a35d2-8e05-47d7-a517-e0725926092d"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:14.596034 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.596828 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.597834 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.598412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.611429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d92871db-d418-4b57-a150-c04cef44dfff req-c3ceb245-5367-4090-a7d3-bdf7bd4fba63 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:14.612236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d92871db-d418-4b57-a150-c04cef44dfff req-c3ceb245-5367-4090-a7d3-bdf7bd4fba63 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:14.634402 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-d92871db-d418-4b57-a150-c04cef44dfff req-c3ceb245-5367-4090-a7d3-bdf7bd4fba63 service nova] Creating event network-vif-plugged:569a35d2-8e05-47d7-a517-e0725926092d for instance 9ad1d56f-357d-443c-a043-471ab99f59e6 on hv-cinder-84414 Jun 06 14:28:14.643593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-d92871db-d418-4b57-a150-c04cef44dfff req-c3ceb245-5367-4090-a7d3-bdf7bd4fba63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155524 Jun 06 14:28:14.644700 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 356/752] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:14.781532 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:14.799363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a279c3b5-7b37-4add-ab77-67e9a82bbddd tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.232595 Jun 06 14:28:14.800972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 397/753] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:14 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:15.215103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:15.216868 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:15.223209 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.223653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.224432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.224860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.270744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-363bb29d-9e24-4373-a7be-c6c6921ef4f0 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059937 Jun 06 14:28:15.271785 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 357/754] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:28:15 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:28:15.348268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:15.348764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:15.357174 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.357694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.358703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.359683 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.391947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:28:15.420623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:15.482920 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9c5e5f2d-1ca0-4628-9379-149d3b66287c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 204 len: 0 microversion: 2.1 time: 0.136894 Jun 06 14:28:15.483405 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 398/755] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:28:15 2022] DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 14:28:15.496029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:15.497297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:15.508411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.509196 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.510641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.511440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.581739 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:15.582444 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:15.589067 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.589515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.590324 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.591391 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.721988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:15.737348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-de081a22-6cbb-4b1c-880a-3d4d8befd5a1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1682 microversion: 2.1 time: 0.248279 Jun 06 14:28:15.738484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 358/756] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:15 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:15.794877 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:15.802757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-56a9cc08-7839-4f95-8bd2-c9d61011bfe5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.225252 Jun 06 14:28:15.803340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 399/757] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:15 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:15.818109 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:15.818716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:15.825695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.826169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.826940 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:15.827365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:15.977653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:15.987732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0a23a265-6f27-453f-b334-180e353caf50 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.173410 Jun 06 14:28:15.988225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 359/758] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:15 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:16.764630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:16.765248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:16.772751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:16.773348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:16.774725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:16.775478 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:16.823599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:16.824359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:16.833519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:16.833926 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:16.834694 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:16.835128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:17.012233 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:17.024862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c9a04095-abc4-4a9f-84b8-2903f5dee9d5 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1682 microversion: 2.1 time: 0.263737 Jun 06 14:28:17.024862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 400/759] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:16 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:17.034358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:17.035680 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:17.049327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:17.054488 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:17.056577 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:17.057099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:17.057992 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:17.065897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-297a681e-d983-4f83-8d68-ee50d34b6cd0 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1363 microversion: 2.1 time: 0.248838 Jun 06 14:28:17.067476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 360/760] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:16 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:17.255740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:17.266400 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a60265fe-0133-44c5-8558-434b56c2e2c7 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.239860 Jun 06 14:28:17.267009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 401/761] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:17 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:18.052738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:18.053525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:18.061255 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.061729 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.062541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.062975 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.093142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:18.094938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:18.109373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.110221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.111746 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.112356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.268256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:18.284692 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3154bf0f-61de-44e6-b1d7-d6c141d19113 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1682 microversion: 2.1 time: 0.235279 Jun 06 14:28:18.286799 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 361/762] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:18 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:18.303951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:18.304748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:18.313943 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.314620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.315586 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.316167 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.334641 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:18.356483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-110c62d8-f88c-4c86-afb8-0b147431ebc6 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1549 microversion: 2.1 time: 0.271717 Jun 06 14:28:18.358322 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 402/763] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:18 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1549 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:18.387351 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:18.388634 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:18.398797 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.400029 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.401820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.403470 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.584219 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-adb04385-c9db-453e-be9f-2d977756a12c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204799 Jun 06 14:28:18.585673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 403/764] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:28:18 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:18.609647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:18.628554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0c8dec82-6345-4bf3-837e-ce5b828607b3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.339664 Jun 06 14:28:18.629755 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 362/765] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:18 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:18.638007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-e3974d27-aa2f-4e3e-99f2-fbc6c188f0ac req-599e500b-bc7c-4208-8456-6050d8bca88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "name": "network-vif-plugged", "status": "completed", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:18.653637 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e3974d27-aa2f-4e3e-99f2-fbc6c188f0ac req-599e500b-bc7c-4208-8456-6050d8bca88e service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:18.656012 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e3974d27-aa2f-4e3e-99f2-fbc6c188f0ac req-599e500b-bc7c-4208-8456-6050d8bca88e service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:18.674346 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-e3974d27-aa2f-4e3e-99f2-fbc6c188f0ac req-599e500b-bc7c-4208-8456-6050d8bca88e service nova] Creating event network-vif-plugged:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:28:18.680658 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-e3974d27-aa2f-4e3e-99f2-fbc6c188f0ac req-599e500b-bc7c-4208-8456-6050d8bca88e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051686 Jun 06 14:28:18.682293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 404/766] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:19.142526 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:19.143804 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:19.156352 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.157575 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.159365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.160672 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.296773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lazy-loading 'services' on Instance uuid 50386bc4-52ea-44da-834e-381f38cc47c3 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:28:19.299674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:19.313182 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:19.314749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:19.326874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.327386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.328520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.329028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.430536 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c256260c-2f2d-43a4-a924-e7e44bd27b00 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments/ba13b314-cf0a-4720-a234-bdba83359006" status: 202 len: 0 microversion: 2.1 time: 0.295583 Jun 06 14:28:19.437513 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 363/767] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:28:19 2022] DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments/ba13b314-cf0a-4720-a234-bdba83359006 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:28:19.445162 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:19.446811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:19.462930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.464078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.465891 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.467236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.537644 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8ac755b3-b429-4ed6-bb35-53bae6614b3a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098161 Jun 06 14:28:19.538707 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 364/768] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:28:19 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:19.615943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:19.629161 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4161c8e2-b7f7-45d1-83bf-5626bb8516dc tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1682 microversion: 2.1 time: 0.324726 Jun 06 14:28:19.629858 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 405/769] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:19 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:19.650065 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:19.650696 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:19.657788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.658219 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.659007 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:19.659468 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:19.855473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:19.864231 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-86e1d29f-faec-420e-ba3b-c73507e306aa tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.219399 Jun 06 14:28:19.864829 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 365/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:19 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:20.505271 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-6c8ea829-bf60-47d6-aa73-6b90386fb246 req-ee5dfec0-82a7-487b-97b6-0222d6ae3f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c1cd6-c5eb-4375-a766-77ca6bd1b4fc", "name": "network-vif-deleted", "tag": "6f067b2c-582f-4229-80f1-49f8804249fb"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:20.522027 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-6c8ea829-bf60-47d6-aa73-6b90386fb246 req-ee5dfec0-82a7-487b-97b6-0222d6ae3f98 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.523720 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-6c8ea829-bf60-47d6-aa73-6b90386fb246 req-ee5dfec0-82a7-487b-97b6-0222d6ae3f98 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.563371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:20.564628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-6c8ea829-bf60-47d6-aa73-6b90386fb246 req-ee5dfec0-82a7-487b-97b6-0222d6ae3f98 service nova] Creating event network-vif-deleted:6f067b2c-582f-4229-80f1-49f8804249fb for instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc on hv-cinder-84414 Jun 06 14:28:20.567940 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:20.585582 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-6c8ea829-bf60-47d6-aa73-6b90386fb246 req-ee5dfec0-82a7-487b-97b6-0222d6ae3f98 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180788 Jun 06 14:28:20.587583 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 406/771] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:20.591868 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.593247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.595561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.596714 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.639533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fafb5242-58ed-44a5-ab69-826542d315f1 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090224 Jun 06 14:28:20.640395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 366/772] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:28:20 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:20.657125 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:20.658395 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:20.665169 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.665889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.666807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.667377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.804309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:20.819218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4d67291f-b06e-4c45-8f41-df10092acc04 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1614 microversion: 2.1 time: 0.167127 Jun 06 14:28:20.833732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 407/773] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:20 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1614 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:20.901090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:20.903073 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:20.922496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.924008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.928126 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:20.929349 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:20.976102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ec845f97-0092-4330-a239-5f9dfb312489 req-9dceaf41-3cf3-45b5-bb54-5809bfcd9a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384c1cd6-c5eb-4375-a766-77ca6bd1b4fc", "name": "network-vif-unplugged", "status": "completed", "tag": "6f067b2c-582f-4229-80f1-49f8804249fb"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:21.027520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ec845f97-0092-4330-a239-5f9dfb312489 req-9dceaf41-3cf3-45b5-bb54-5809bfcd9a89 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.028934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ec845f97-0092-4330-a239-5f9dfb312489 req-9dceaf41-3cf3-45b5-bb54-5809bfcd9a89 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.051420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ec845f97-0092-4330-a239-5f9dfb312489 req-9dceaf41-3cf3-45b5-bb54-5809bfcd9a89 service nova] Creating event network-vif-unplugged:6f067b2c-582f-4229-80f1-49f8804249fb for instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc on hv-cinder-84414 Jun 06 14:28:21.059787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ec845f97-0092-4330-a239-5f9dfb312489 req-9dceaf41-3cf3-45b5-bb54-5809bfcd9a89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094081 Jun 06 14:28:21.060802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 408/774] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:21.135517 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:21.146891 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d36a5cf1-acd2-4464-a617-8acef8923d4a tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1358 microversion: 2.1 time: 0.263776 Jun 06 14:28:21.160781 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 367/775] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:20 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:21.654566 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:21.655684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:21.663165 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.663998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.665026 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.665630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.704415 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c0e033d7-2b14-4d87-9e2a-4cbfa1a9923c tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056250 Jun 06 14:28:21.705364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 409/776] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:28:21 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:28:21.792810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:21.793863 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:21.802552 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.803328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.805488 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.806030 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.841769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:21.842492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:21.850490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.853915 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.855387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.861418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:28:21.863482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.933426 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:21.934868 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:21.935762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'fault' on Instance uuid 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:28:21.986732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:21.995759 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cb43ab34-9230-4d8c-b218-1c422eef9bdb tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 200 len: 1332 microversion: 2.1 time: 0.158352 Jun 06 14:28:21.997695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 410/777] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:21 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 1332 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:22.036854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c1162cfd-5f60-4899-9571-e00535ae25df tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 204 len: 0 microversion: 2.1 time: 0.248158 Jun 06 14:28:22.037976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 368/778] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:28:21 2022] DELETE /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:28:22.049799 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:22.051930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:22.065459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.066291 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.067704 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.068453 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.174776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:22.176481 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:22.189027 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.190243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.192869 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.193984 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.296550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:22.311219 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-29c0b1dd-00d2-44be-af7d-689d4e609d3f tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1689 microversion: 2.1 time: 0.265795 Jun 06 14:28:22.312564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 411/779] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:22 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:22.373999 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:22.382364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c93f523f-1e63-4915-872e-6147ab8248e0 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1548 microversion: 2.1 time: 0.216582 Jun 06 14:28:22.383189 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 369/780] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:22 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:22.400524 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:22.401149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:22.408670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.409072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.409884 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.410328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.592660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:22.600563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b40e9144-ba73-4b0e-b978-ac4396029a20 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1548 microversion: 2.1 time: 0.203918 Jun 06 14:28:22.601146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 412/781] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:22 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:22.616992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:22.620396 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:22.621159 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Searching by: {'deleted': False, 'project_id': 'd1af47083c644609a4a84b1273a4087f'} {{(pid=117604) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 06 14:28:22.628474 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.628916 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.629740 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.630253 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.635463 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-d7b66e9e-3066-40ca-bd08-ce54c933b9ba req-9128d5b4-3158-4e58-b615-3c3551427398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad1d56f-357d-443c-a043-471ab99f59e6", "tag": "569a35d2-8e05-47d7-a517-e0725926092d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:22.644789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d7b66e9e-3066-40ca-bd08-ce54c933b9ba req-9128d5b4-3158-4e58-b615-3c3551427398 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.645234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d7b66e9e-3066-40ca-bd08-ce54c933b9ba req-9128d5b4-3158-4e58-b615-3c3551427398 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.657911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-d7b66e9e-3066-40ca-bd08-ce54c933b9ba req-9128d5b4-3158-4e58-b615-3c3551427398 service nova] Creating event network-changed:569a35d2-8e05-47d7-a517-e0725926092d for instance 9ad1d56f-357d-443c-a043-471ab99f59e6 on hv-cinder-84414 Jun 06 14:28:22.663151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-d7b66e9e-3066-40ca-bd08-ce54c933b9ba req-9128d5b4-3158-4e58-b615-3c3551427398 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031231 Jun 06 14:28:22.663730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 413/782] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:22.729283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.multi_cell_list [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117604) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 06 14:28:22.837247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8a26459b-c78e-4e72-bbd6-8d1f1aabd94f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223890 Jun 06 14:28:22.838127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 370/783] 10.222.0.13 () {58 vars in 1124 bytes} [Mon Jun 6 14:28:22 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:22.849949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:22.850672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:22.857605 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.858088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:22.858886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:22.859330 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:23.011131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:23.016857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:23.017699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:23.022837 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d9ce4182-cda0-4c62-a63d-34404ba72fa2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1548 microversion: 2.1 time: 0.177121 Jun 06 14:28:23.023751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 414/784] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:22 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:23.025267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:23.025830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:23.026707 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:23.027216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:23.044295 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc HTTP/1.1 Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:28:23.046482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:28:23.049226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '384c1cd6-c5eb-4375-a766-77ca6bd1b4fc'} Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:23.051417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:28:23.054281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:23.056702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:23.056702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f67e5386-661c-44b9-b16b-cccf20e24e51 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 404 len: 111 microversion: 2.1 time: 0.036831 Jun 06 14:28:23.056702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 371/785] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:23 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:28:23.057617 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-74f1550a-17d2-48e9-92e4-da4f1b345cd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '.version_select at 0x7fae8a7e8160>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:23.081601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-74f1550a-17d2-48e9-92e4-da4f1b345cd8 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363899217" status: 202 len: 0 microversion: 2.1 time: 0.028133 Jun 06 14:28:23.082230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 415/786] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 14:28:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363899217 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 14:28:23.332435 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:23.333311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:23.342946 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:23.343730 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:23.345124 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:23.346821 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:23.597085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:23.609741 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f376a57e-28eb-4949-aa1b-b3f6eb3cf571 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1689 microversion: 2.1 time: 0.283009 Jun 06 14:28:23.610388 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 372/787] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:23 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1689 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:23.988020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a9cb4f0b-ec2a-46c8-a348-833b016b8679 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: .version_select at 0x7fae90074670>, body: {"keypair": {"name": "tempest-keypair-461600363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjKL8UMCFNg7tc7eyUj1UuTxEHvdrTBTHxbM+fFGYt/+ZJ8P0rN2wrAgCfL35gJlrv7REAfd3/b8J6FqWCeLJ/OvVJAGoaNTJdJKTjVwbTV0FDLuV9JaMz4hSul4iGp/w=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:24.005298 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-a9cb4f0b-ec2a-46c8-a348-833b016b8679 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:28:24.009851 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-a9cb4f0b-ec2a-46c8-a348-833b016b8679 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:28:24.034703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a9cb4f0b-ec2a-46c8-a348-833b016b8679 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050612 Jun 06 14:28:24.035364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 416/788] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:28:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:24.632745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:24.633466 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:24.643341 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:24.643802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:24.644603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:24.645044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:24.802979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c1376fd-2324-4dac-90d0-b7d8c80a8db5"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:24.804565 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:24.814338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:24.815114 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:24.816343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:24.817211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:24.927155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:24.937356 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dfac36fd-2847-457a-82c0-f6571cf2d04d tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1689 microversion: 2.1 time: 0.308848 Jun 06 14:28:24.937986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 373/789] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:24 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1689 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:25.622672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:25.640821 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f5bad2e9-7f23-4ee4-996e-cdefbfca8269 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844578 Jun 06 14:28:25.645749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 417/790] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:28:24 2022] POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:25.963137 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:25.966242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:25.978980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:25.980328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:25.982787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:25.984372 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:26.037626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1640852088", "imageRef": "502431c8-2ea1-4223-888e-93e4cc5d30f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c80cddf-8aa7-4709-b4d4-0401b235b6d1"}], "security_groups": [{"name": "tempest-securitygroup--416953017"}], "key_name": "tempest-keypair-461600363", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:26.237213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] validate_networks() for [('5c80cddf-8aa7-4709-b4d4-0401b235b6d1', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:28:26.318001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:26.331260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8f91fde1-499b-460c-afc2-86dd293cb71a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1689 microversion: 2.1 time: 0.377283 Jun 06 14:28:26.332411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 374/791] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:25 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1689 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:26.472447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:26.725813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:28:26.726524 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:28:26.727017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:28:26.727501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:28:26.727999 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:28:26.740734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:26.741540 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:26.742437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:26.742931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:26.763114 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:28:26.767776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Getting quotas for user 53505ac8ab6142a6bf0c3d6fe1cc721f and project f185078fd436428e818d6dba472bacb8. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:28:26.782068 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:28:26.784813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='502431c8-2ea1-4223-888e-93e4cc5d30f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:28:26.853063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b763f263-8672-4d35-a76d-97cca3c09ca4 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.827171 Jun 06 14:28:26.859702 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 418/792] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:28:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:28:26.869427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c1b018bc-809f-4cbe-b901-75ac52c6000b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:26.871892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c1b018bc-809f-4cbe-b901-75ac52c6000b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:27.375230 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:27.379714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:27.407168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c1b018bc-809f-4cbe-b901-75ac52c6000b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:27.428887 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:27.429936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:27.436210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:27.438173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:27.456899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c1b018bc-809f-4cbe-b901-75ac52c6000b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1241 microversion: 2.1 time: 0.579779 Jun 06 14:28:27.467029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 375/793] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:26 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1241 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:27.487109 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-2d435d34-a1aa-4ae9-8470-e5e91325a512 req-808334cc-e0df-496a-9ad3-2e98ac08ca7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50386bc4-52ea-44da-834e-381f38cc47c3", "name": "network-vif-deleted", "tag": "df54d3c7-86bf-4c37-ba45-0d8672392f1d"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:27.538178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2d435d34-a1aa-4ae9-8470-e5e91325a512 req-808334cc-e0df-496a-9ad3-2e98ac08ca7e service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:27.539255 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2d435d34-a1aa-4ae9-8470-e5e91325a512 req-808334cc-e0df-496a-9ad3-2e98ac08ca7e service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:27.572697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-2d435d34-a1aa-4ae9-8470-e5e91325a512 req-808334cc-e0df-496a-9ad3-2e98ac08ca7e service nova] Creating event network-vif-deleted:df54d3c7-86bf-4c37-ba45-0d8672392f1d for instance 50386bc4-52ea-44da-834e-381f38cc47c3 on hv-cinder-84414 Jun 06 14:28:27.583883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-2d435d34-a1aa-4ae9-8470-e5e91325a512 req-808334cc-e0df-496a-9ad3-2e98ac08ca7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109902 Jun 06 14:28:27.585833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 376/794] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:27.699276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:27.710637 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fd47df4c-714e-460b-a09d-657a57102038 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 200 len: 1330 microversion: 2.1 time: 0.362076 Jun 06 14:28:27.721263 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 419/795] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:27 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 1330 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:28.502057 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:28.504398 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:28.519064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:28.520251 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:28.521770 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:28.522583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:28.662817 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:28.677997 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-48e6b098-870d-41dd-b230-3722590e57b1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1301 microversion: 2.1 time: 0.186085 Jun 06 14:28:28.679472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 377/796] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:28 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1301 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:28.728846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:28.730490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 50386bc4-52ea-44da-834e-381f38cc47c3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:28.739986 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:28.740728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:28.742001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:28.742455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:28.761576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] HTTP exception thrown: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 could not be found. Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Request method failure captured: Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 HTTP/1.1 Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing26LYqRK8mDvncmOjod4lEogL9ReU4MHXEE4Cd1AWDJgdZbamX_Nz8dmwL9DkSO8vD0b4fdm8sCryBJV9nj5P4Kd_wWgZ_2KKDlhoOCRZH9zyQgcusKXTa162H1DuVz3xLUYN_YX4lvBlS5SUyMdwKuAK9Q1dXYNNBlzPYoxGjOLbc Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:28:28.764354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5e2e414f37bf4a89ac18e1836c793b0b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}] Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 86f9bcac527c45d6bc81b70e26544924 Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 could not be found. Jun 06 14:28:28.766203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '50386bc4-52ea-44da-834e-381f38cc47c3'} Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 could not be found. Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:28.767104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 could not be found. Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 could not be found. Jun 06 14:28:28.768564 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:28.771319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Returning 404 to user: Instance 50386bc4-52ea-44da-834e-381f38cc47c3 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:28.772559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e3c0b0c2-2325-4e60-b628-70c35dbfe667 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3" status: 404 len: 111 microversion: 2.1 time: 0.047680 Jun 06 14:28:28.773309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 420/797] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:28 2022] GET /compute/v2.1/servers/50386bc4-52ea-44da-834e-381f38cc47c3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:28:28.782695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d1e3a9d-79b1-42e5-b905-971019fc1be0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '.version_select at 0x7fae90461c10>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:28.808374 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8d1e3a9d-79b1-42e5-b905-971019fc1be0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-889697557" status: 202 len: 0 microversion: 2.1 time: 0.029553 Jun 06 14:28:28.814338 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 378/798] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 14:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-889697557 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 14:28:29.700787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:29.701692 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:29.713078 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:29.714125 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:29.717431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:29.718094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:29.944731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:29.957458 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cb013f3c-ba3f-49d0-90a5-ce61fdcfdfe2 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.261729 Jun 06 14:28:29.958076 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 421/799] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:29 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:30.579521 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-aaf8e913-fb31-45d6-abe5-3f5b53a4f55f req-44d7c76d-a6ca-4765-9dac-b46cc9e97fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31d82d4-d308-4faf-a71d-275dd69a615e", "tag": "54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:30.603652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-aaf8e913-fb31-45d6-abe5-3f5b53a4f55f req-44d7c76d-a6ca-4765-9dac-b46cc9e97fa7 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:30.604284 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-aaf8e913-fb31-45d6-abe5-3f5b53a4f55f req-44d7c76d-a6ca-4765-9dac-b46cc9e97fa7 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:30.629875 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-aaf8e913-fb31-45d6-abe5-3f5b53a4f55f req-44d7c76d-a6ca-4765-9dac-b46cc9e97fa7 service nova] Creating event network-changed:54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1 for instance f31d82d4-d308-4faf-a71d-275dd69a615e on hv-cinder-84414 Jun 06 14:28:30.638227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-aaf8e913-fb31-45d6-abe5-3f5b53a4f55f req-44d7c76d-a6ca-4765-9dac-b46cc9e97fa7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063669 Jun 06 14:28:30.639330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 379/800] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:30.981949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:30.984827 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:30.997977 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:30.998712 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:31.000328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:31.001007 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:31.177264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:31.188624 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6eb01ff5-7ae3-4d1d-bcab-6cd51370e157 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.214856 Jun 06 14:28:31.189829 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 422/801] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:30 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:32.102040 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:32.102926 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:32.115397 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:32.116174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:32.117601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:32.118418 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:32.175744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:28:32.206572 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:32.207214 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:32.214497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:32.215533 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:32.216549 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:32.217113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:32.266155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:32.317343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-98e1278f-cd37-4a13-b9dd-db48f36083a0 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 204 len: 0 microversion: 2.1 time: 0.222697 Jun 06 14:28:32.320907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 380/802] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:28:32 2022] DELETE /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:28:32.327254 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:32.327968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:32.343074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:32.343590 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:32.344456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:32.344964 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:32.412318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:32.427052 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7223c89c-29d8-4f8d-9742-36bbd6efacb9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.223892 Jun 06 14:28:32.428134 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 423/803] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:32 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:32.513158 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:32.521607 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a9da292c-1abe-493d-9da8-8f1d367b09bc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1508 microversion: 2.1 time: 0.199145 Jun 06 14:28:32.522313 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 381/804] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:32 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:33.447051 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:33.447703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:33.456461 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:33.456912 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:33.457729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:33.458169 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:33.544695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:33.545864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:33.549426 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:33.562687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:33.563499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:33.564947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:33.565792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:33.628602 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:33.639037 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-70818194-bd29-4f78-a80d-97bee93bd8be tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.196012 Jun 06 14:28:33.639756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 424/805] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:33 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:33.733070 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:33.742798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fdc1ee12-08d6-46d8-b5dc-a137d8a27596 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1508 microversion: 2.1 time: 0.206588 Jun 06 14:28:33.743458 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 382/806] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:33 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:34.657647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:34.658579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:34.673627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:34.675161 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:34.677934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:34.679140 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:34.773188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:34.777049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:34.794178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:34.795840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:34.797876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:34.800557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:34.982764 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:34.994864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4bbfba99-2ec9-4624-b52a-b04464184321 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.341178 Jun 06 14:28:35.005765 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 425/807] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:34 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:35.054201 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:35.069995 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2320dddb-7cf9-4712-8e73-4a098b59c374 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1508 microversion: 2.1 time: 0.310706 Jun 06 14:28:35.072289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 383/808] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:34 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:35.096164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:35.096676 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:35.103698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:35.104142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:35.106155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:35.107406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:35.136584 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-35c91e47-7a35-4ec3-b747-cca6730bc872 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/ips" status: 200 len: 151 microversion: 2.20 time: 0.046415 Jun 06 14:28:35.141777 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 426/809] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jun 6 14:28:35 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 14:28:35.475836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ab16bbed-a07c-45dc-9873-41fb6b12bfa0 req-53379453-6ed0-4f34-9df3-3832d8951784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edfd401-1a2a-4b25-84da-aa19d6f4c5d3", "name": "network-vif-deleted", "tag": "e9b28d33-7c58-4053-8fa5-16a9e6aa2aef"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:35.489585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ab16bbed-a07c-45dc-9873-41fb6b12bfa0 req-53379453-6ed0-4f34-9df3-3832d8951784 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:35.491175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ab16bbed-a07c-45dc-9873-41fb6b12bfa0 req-53379453-6ed0-4f34-9df3-3832d8951784 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:35.533863 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ab16bbed-a07c-45dc-9873-41fb6b12bfa0 req-53379453-6ed0-4f34-9df3-3832d8951784 service nova] Creating event network-vif-deleted:e9b28d33-7c58-4053-8fa5-16a9e6aa2aef for instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 on hv-cinder-84414 Jun 06 14:28:35.548748 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-ab16bbed-a07c-45dc-9873-41fb6b12bfa0 req-53379453-6ed0-4f34-9df3-3832d8951784 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077408 Jun 06 14:28:35.549389 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 384/810] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:35.813781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:35.814895 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:35.825628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:35.826550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:35.827530 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:35.828150 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.012772 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:36.015999 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:36.017737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:36.026372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-46ca7beb-d80f-46e5-97b8-0bf06e532c79 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1594 microversion: 2.1 time: 0.219611 Jun 06 14:28:36.028699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 427/811] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:35 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1594 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:36.048257 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:36.055127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.057391 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:36.057548 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.102988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:36.105091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:36.124812 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:36.128482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.131450 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:36.132950 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.211261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:36.212643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.213632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lazy-loading 'fault' on Instance uuid 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:28:36.315246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:36.331202 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2283f1ab-9ace-47a2-a6f9-1d8485cb193b tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 200 len: 1312 microversion: 2.1 time: 0.243316 Jun 06 14:28:36.333207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 428/812] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:36 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:36.364838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:36.375234 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-40323032-8d3d-4dcc-adf7-290dadb49d14 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.365982 Jun 06 14:28:36.376334 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 385/813] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:36 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:36.618882 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-e3a84121-ee93-4070-9544-5bd095b83252 req-8daeb309-1381-4ff7-a46e-7b44ebd4c6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31d82d4-d308-4faf-a71d-275dd69a615e", "name": "network-vif-plugged", "status": "completed", "tag": "54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:36.638385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e3a84121-ee93-4070-9544-5bd095b83252 req-8daeb309-1381-4ff7-a46e-7b44ebd4c6d3 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:36.638385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e3a84121-ee93-4070-9544-5bd095b83252 req-8daeb309-1381-4ff7-a46e-7b44ebd4c6d3 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:36.653925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-e3a84121-ee93-4070-9544-5bd095b83252 req-8daeb309-1381-4ff7-a46e-7b44ebd4c6d3 service nova] Creating event network-vif-plugged:54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1 for instance f31d82d4-d308-4faf-a71d-275dd69a615e on hv-cinder-84414 Jun 06 14:28:36.665763 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-e3a84121-ee93-4070-9544-5bd095b83252 req-8daeb309-1381-4ff7-a46e-7b44ebd4c6d3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049462 Jun 06 14:28:36.666860 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 429/814] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:37.319529 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:37.320490 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:37.332878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.333682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.335168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.335934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.351620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:37.352445 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:37.355357 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:37.356879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=10 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:37.366553 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.367006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.368057 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.368663 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.385112 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] HTTP exception thrown: Instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 could not be found. Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Request method failure captured: Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 HTTP/1.1 Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing26LYqRK8mDvncmOjod4lEogL9ReU4MHXEE4Cd1AWDJgdZbamX_Nz8dmwL9DkSO8vD0b4fdm8sCryBJV9nj5P4Kd_wWgZ_2KKDlhoOCRZH9zyQgcusKXTa162H1DuVz3xLUYN_YX4lvBlS5SUyMdwKuAK9Q1dXYNNBlzPYoxGjOLbc Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:28:37.387366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5e2e414f37bf4a89ac18e1836c793b0b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}] Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 86f9bcac527c45d6bc81b70e26544924 Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 could not be found. Jun 06 14:28:37.390568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '0edfd401-1a2a-4b25-84da-aa19d6f4c5d3'} Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 could not be found. Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:37.392418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 could not be found. Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 could not be found. Jun 06 14:28:37.396519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:37.400474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Returning 404 to user: Instance 0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:37.400643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lazy-loading 'flavor' on Instance uuid 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:28:37.400811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-94535059-6c51-4e31-b976-5ab32701317a tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3" status: 404 len: 111 microversion: 2.1 time: 0.041829 Jun 06 14:28:37.400811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 430/815] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:37 2022] GET /compute/v2.1/servers/0edfd401-1a2a-4b25-84da-aa19d6f4c5d3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:28:37.403962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:37.405438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:37.411823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.412373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.413273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.416721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.430167 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:37.450981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:28:37.555567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ba179b12-94c9-4560-92f0-12e80a6c89b3 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 204 len: 0 microversion: 2.1 time: 0.159108 Jun 06 14:28:37.556616 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 431/816] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:28:37 2022] DELETE /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:28:37.566760 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:37.568848 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:37.581192 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.582091 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.582899 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.583335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.753770 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:37.765769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6736512e-0326-4f6a-b6a9-ce0fef044646 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.206990 Jun 06 14:28:37.766087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 432/817] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:37 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:37.768138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8fbfaf50-bde9-4567-b04f-11ae8ad769b8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/action" status: 202 len: 0 microversion: 2.20 time: 0.457081 Jun 06 14:28:37.769104 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 386/818] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 14:28:37 2022] POST /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:28:37.781324 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:37.782286 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:37.789372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:37.790035 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:37.792182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.793450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.794915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.795520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.798672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.799218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:37.800058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:37.800523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:38.076848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:38.084807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:38.094812 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:38.098941 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:38.101103 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-07726b91-2928-4975-a5f4-2aa1c64b0bdc tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.318086 Jun 06 14:28:38.101981 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cf674846-1158-42be-a294-7ecfdef7b38a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.326930 Jun 06 14:28:38.102371 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 433/819] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:37 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:38.103520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 387/820] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:37 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:38.788914 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:38.790025 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:38.799390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:38.800194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:38.801127 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:38.801699 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:38.844190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-dd2f5ff1-bfa5-439e-a697-f1cb33bf7c64 req-9b35504e-13ca-4756-a6aa-7a1d5b21902d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:38.862042 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-dd2f5ff1-bfa5-439e-a697-f1cb33bf7c64 req-9b35504e-13ca-4756-a6aa-7a1d5b21902d service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:38.862872 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-dd2f5ff1-bfa5-439e-a697-f1cb33bf7c64 req-9b35504e-13ca-4756-a6aa-7a1d5b21902d service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:38.886791 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-dd2f5ff1-bfa5-439e-a697-f1cb33bf7c64 req-9b35504e-13ca-4756-a6aa-7a1d5b21902d service nova] Creating event network-changed:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:28:38.898430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-dd2f5ff1-bfa5-439e-a697-f1cb33bf7c64 req-9b35504e-13ca-4756-a6aa-7a1d5b21902d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061509 Jun 06 14:28:38.899525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 388/821] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:39.120745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:39.125141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:39.126239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:39.133747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a90b4fa9-e794-4232-911d-f33559f4a0ac tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1366 microversion: 2.1 time: 0.348929 Jun 06 14:28:39.136412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 434/822] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:38 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:39.140666 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:39.141154 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:39.142179 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:39.142781 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:39.142938 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:39.143782 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:39.150464 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:39.151319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:39.153205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:39.153924 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:39.174403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:39.433494 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:39.437919 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:39.447232 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:39.447876 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fa9302db-6952-4d7c-a76b-c6884914d692 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.330569 Jun 06 14:28:39.449618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:39.449816 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 389/823] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:39 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:39.451444 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-edaa20d5-fb0d-4823-a3b5-8b5a2e2e5298 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.312759 Jun 06 14:28:39.452155 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 435/824] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:39 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:40.159466 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:40.160465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:40.172865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.173642 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.175082 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.175865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.426702 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-704691580"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:40.427756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:40.437912 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.438153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:40.438638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.439972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.440679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.450841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-50ef4614-3799-43ee-91d5-0442e2f2e2c7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1556 microversion: 2.1 time: 0.299945 Jun 06 14:28:40.452309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 390/825] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:40 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1556 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:40.470976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:40.471921 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:40.483107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.483879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.485166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.485862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.662185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.network.security_group_api [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Adding security group 92dc4775-04be-49ea-8805-c8efd1c6d350 to port 02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e Jun 06 14:28:40.772505 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:40.782213 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9945b385-8d69-49bb-a3df-da9c3fb206ed tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1522 microversion: 2.1 time: 0.318280 Jun 06 14:28:40.782813 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 391/826] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:40 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:40.787862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:40.788472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:40.803076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.804039 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:40.805580 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:40.806483 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.110794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:41.134922 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:41.142618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:41.144710 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7b900443-df7f-43d9-b67d-b05fa98726ff tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.360249 Jun 06 14:28:41.146247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 392/827] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:40 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:41.156722 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:41.157783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:41.166985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.170321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.171636 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.172244 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.323298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5788daf4-c535-411f-a744-df55c06c6c8d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175432 Jun 06 14:28:41.323985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 393/828] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 14:28:41 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:41.585544 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-37b86a58-755d-41b6-85a8-ac11d3e27135 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/action" status: 202 len: 0 microversion: 2.1 time: 1.165232 Jun 06 14:28:41.586808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 436/829] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:28:40 2022] POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/action => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:28:41.594924 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:41.595633 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:41.606138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.608629 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.609698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.610193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-8069a6b5-84ad-4176-a7eb-33782060e087 req-5127096b-0ecf-428a-ae84-e9cf0acd02b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:41.610865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.631387 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8069a6b5-84ad-4176-a7eb-33782060e087 req-5127096b-0ecf-428a-ae84-e9cf0acd02b2 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.635278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8069a6b5-84ad-4176-a7eb-33782060e087 req-5127096b-0ecf-428a-ae84-e9cf0acd02b2 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.675726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-8069a6b5-84ad-4176-a7eb-33782060e087 req-5127096b-0ecf-428a-ae84-e9cf0acd02b2 service nova] Creating event network-changed:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:28:41.690893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-8069a6b5-84ad-4176-a7eb-33782060e087 req-5127096b-0ecf-428a-ae84-e9cf0acd02b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084588 Jun 06 14:28:41.694239 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 437/830] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:41.810633 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:41.811416 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:41.841095 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.842011 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:41.843498 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:41.844431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:42.000715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f9bcac527c45d6bc81b70e26544924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e414f37bf4a89ac18e1836c793b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:42.015575 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3eb518af-d8c8-47aa-9430-e7e134bae376 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 200 len: 1306 microversion: 2.1 time: 0.215640 Jun 06 14:28:42.016573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 438/831] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:41 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 1306 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:28:42.021973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-8673b3d0-ec6e-44d0-8a5d-a59002b03cab req-468d273a-f0fc-4022-81eb-3087ce9bb975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7272e33-1832-487c-9463-50a3efc67404", "name": "network-vif-deleted", "tag": "f5eef75b-900b-4277-ba84-469c7ff477cd"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:42.036417 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8673b3d0-ec6e-44d0-8a5d-a59002b03cab req-468d273a-f0fc-4022-81eb-3087ce9bb975 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:42.038604 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8673b3d0-ec6e-44d0-8a5d-a59002b03cab req-468d273a-f0fc-4022-81eb-3087ce9bb975 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:42.054810 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-8673b3d0-ec6e-44d0-8a5d-a59002b03cab req-468d273a-f0fc-4022-81eb-3087ce9bb975 service nova] Creating event network-vif-deleted:f5eef75b-900b-4277-ba84-469c7ff477cd for instance b7272e33-1832-487c-9463-50a3efc67404 on hv-cinder-84414 Jun 06 14:28:42.061526 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-8673b3d0-ec6e-44d0-8a5d-a59002b03cab req-468d273a-f0fc-4022-81eb-3087ce9bb975 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043329 Jun 06 14:28:42.062375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 439/832] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:42.076605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:42.086378 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-90e5f4c4-1074-4a38-a4e9-f4310c5a2683 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1640 microversion: 2.1 time: 0.495133 Jun 06 14:28:42.092403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 394/833] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:41 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1640 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:28:42.181556 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:42.182306 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:42.192447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:42.193071 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:42.194309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:42.194922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:42.463936 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:42.472977 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:42.474972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:42.476528 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-65eb2bfa-b225-4e6a-98c5-2bcbf1b931dd tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.306061 Jun 06 14:28:42.488993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 440/834] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:42 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:43.050492 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:43.051389 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] [instance: b7272e33-1832-487c-9463-50a3efc67404] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:43.055124 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:43.063075 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:43.063517 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:43.064330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:43.064771 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:43.082470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] HTTP exception thrown: Instance b7272e33-1832-487c-9463-50a3efc67404 could not be found. Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Request method failure captured: Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 HTTP/1.1 Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing26LYqRK8mDvncmOjod4lEogL9ReU4MHXEE4Cd1AWDJgdZbamX_Nz8dmwL9DkSO8vD0b4fdm8sCryBJV9nj5P4Kd_wWgZ_2KKDlhoOCRZH9zyQgcusKXTa162H1DuVz3xLUYN_YX4lvBlS5SUyMdwKuAK9Q1dXYNNBlzPYoxGjOLbc Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:28:43.084168 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5e2e414f37bf4a89ac18e1836c793b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5e2e414f37bf4a89ac18e1836c793b0b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5e2e414f37bf4a89ac18e1836c793b0b"}]}] Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 5e2e414f37bf4a89ac18e1836c793b0b Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163409717 Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 86f9bcac527c45d6bc81b70e26544924 Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163409717-project Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance b7272e33-1832-487c-9463-50a3efc67404 could not be found. Jun 06 14:28:43.087382 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'b7272e33-1832-487c-9463-50a3efc67404'} Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7272e33-1832-487c-9463-50a3efc67404 could not be found. Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:43.089087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7272e33-1832-487c-9463-50a3efc67404 could not be found. Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7272e33-1832-487c-9463-50a3efc67404 could not be found. Jun 06 14:28:43.092441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:43.096298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] Returning 404 to user: Instance b7272e33-1832-487c-9463-50a3efc67404 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:43.096298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3fa61959-cca4-4ca5-9db7-22fb09a64472 tempest-ServerRescueNegativeTestJSON-1163409717 tempest-ServerRescueNegativeTestJSON-1163409717-project] 10.222.0.13 "GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404" status: 404 len: 111 microversion: 2.1 time: 0.041896 Jun 06 14:28:43.096298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 395/835] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:28:43 2022] GET /compute/v2.1/servers/b7272e33-1832-487c-9463-50a3efc67404 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:28:43.499312 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:43.500267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:43.512229 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:43.513505 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:43.515252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:43.516258 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:43.718473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-4dee6b59-19f4-4e43-8f92-8779cd5c30db req-4a907a6f-c411-4a57-bb2f-bdc6d32c0524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31d82d4-d308-4faf-a71d-275dd69a615e", "tag": "54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:43.739221 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-4dee6b59-19f4-4e43-8f92-8779cd5c30db req-4a907a6f-c411-4a57-bb2f-bdc6d32c0524 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:43.740510 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-4dee6b59-19f4-4e43-8f92-8779cd5c30db req-4a907a6f-c411-4a57-bb2f-bdc6d32c0524 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:43.750031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:43.758178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-4dee6b59-19f4-4e43-8f92-8779cd5c30db req-4a907a6f-c411-4a57-bb2f-bdc6d32c0524 service nova] Creating event network-changed:54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1 for instance f31d82d4-d308-4faf-a71d-275dd69a615e on hv-cinder-84414 Jun 06 14:28:43.765252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-4dee6b59-19f4-4e43-8f92-8779cd5c30db req-4a907a6f-c411-4a57-bb2f-bdc6d32c0524 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056721 Jun 06 14:28:43.766225 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 396/836] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:43.770061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:43.771880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:43.773338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-caf16581-a3a9-4546-a78c-7512e4204509 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.280554 Jun 06 14:28:43.774319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 441/837] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:43 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:44.805144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:44.806578 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:44.820320 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:44.821131 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:44.822659 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:44.823768 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:45.038016 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:45.056678 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:45.063180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:45.065575 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a2c208d4-85cb-4560-9c59-0e07cac859ba tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.269278 Jun 06 14:28:45.074465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 397/838] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:44 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:46.095109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:46.096552 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:46.106539 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:46.107304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:46.108751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:46.109495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:46.360702 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:46.380018 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:46.383447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:46.385569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b2ed6a6f-2b99-4c1b-99fc-df9dd50a83f6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.296038 Jun 06 14:28:46.389282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 442/839] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:46 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:47.411351 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:47.412634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:47.426573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:47.427972 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:47.430260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:47.431515 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:47.444263 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:47.635815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:47.651123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:47.653572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:47.655050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-15e1f351-bed7-4f14-8e33-1271cf48ce51 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.252168 Jun 06 14:28:47.655782 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 398/840] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:47 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:48.677555 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:48.681586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:48.692709 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:48.693193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:48.694088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:48.695343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:48.924843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:48.942298 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:48.945886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:48.948339 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e783d832-2e69-4f8b-bc6f-4cda63a65b3d tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.276007 Jun 06 14:28:48.950398 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 443/841] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:48 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:49.971178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:49.971936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:49.980422 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:49.981519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:49.982375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:49.982989 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:50.198190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:50.213502 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:50.216565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:50.218744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cd03aeb4-342b-4457-8221-75a4f9e3a466 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.251213 Jun 06 14:28:50.219635 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 399/842] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:49 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:50.457555 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d51434ac-c81b-44ed-8bf2-7a3fadbda574 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Action: 'create', calling method: .version_select at 0x7fae8a594ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-52627567"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:50.861614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d51434ac-c81b-44ed-8bf2-7a3fadbda574 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.551339 Jun 06 14:28:50.862312 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 444/843] 10.222.0.13 () {60 vars in 1154 bytes} [Mon Jun 6 14:28:50 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 553 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 14:28:50.875188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fc4b08cf-20d2-4635-84d4-3ae0846b6db8 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8afb0ee0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:50.935061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fc4b08cf-20d2-4635-84d4-3ae0846b6db8 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 200 len: 343 microversion: 2.1 time: 0.064260 Jun 06 14:28:50.936231 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 400/844] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:28:50 2022] GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 343 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:51.242217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:51.242724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:51.251397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:51.251864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:51.252694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:51.253154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:51.453360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:51.469497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:51.472850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:51.474890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7ed4432c-5133-40f0-8881-e60a3f1f8e47 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.237130 Jun 06 14:28:51.475506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 445/845] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:51 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:51.952953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-86811f9c-e2c8-48f3-a13d-c3752600aea5 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8afdfe50>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:52.049909 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-86811f9c-e2c8-48f3-a13d-c3752600aea5 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 200 len: 344 microversion: 2.1 time: 0.103283 Jun 06 14:28:52.050506 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 401/846] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:28:51 2022] GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:52.063347 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-83a3177e-2aa6-4aa5-8aac-ca0744502145 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Action: 'create', calling method: .version_select at 0x7fae8a714670>, body: {"snapshot": {"volume_id": "ac344360-a4af-47cb-8531-1d485a7e5844", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-157089736"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:28:52.280673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-83a3177e-2aa6-4aa5-8aac-ca0744502145 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.222525 Jun 06 14:28:52.281276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 446/847] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Jun 6 14:28:52 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:52.292090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-23d59499-e5af-4483-8337-b7c1ea8a5c3b tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae94063430>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:52.344493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-23d59499-e5af-4483-8337-b7c1ea8a5c3b tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 200 len: 286 microversion: 2.1 time: 0.056821 Jun 06 14:28:52.345084 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 402/848] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:52 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:52.356879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4f3247b7-ec98-4c70-af56-3d7b63c82619 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae900b33a0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:52.393866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4f3247b7-ec98-4c70-af56-3d7b63c82619 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.041952 Jun 06 14:28:52.394831 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 447/849] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jun 6 14:28:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:52.409883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cbbbf76a-ed1a-4a81-b5e6-a831ed2bc50f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8af1b9d0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:52.448264 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cbbbf76a-ed1a-4a81-b5e6-a831ed2bc50f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 200 len: 286 microversion: 2.1 time: 0.046307 Jun 06 14:28:52.448911 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 403/850] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:52 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:52.494141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:52.494989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:52.503286 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:52.503819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:52.504745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:52.505244 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:52.661001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:52.671560 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:52.673272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:52.674707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0531f54c-4619-476d-b495-5abf6861eb81 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.184913 Jun 06 14:28:52.675367 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 448/851] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:52 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:53.461260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a765a3ef-dc54-4ac9-96fb-ff708593dd02 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8af58820>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:53.496220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a765a3ef-dc54-4ac9-96fb-ff708593dd02 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 200 len: 286 microversion: 2.1 time: 0.039348 Jun 06 14:28:53.497041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 404/852] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:53 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:53.696415 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:53.697368 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:53.707483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:53.707933 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:53.708812 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:53.709246 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:53.892994 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:53.909466 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:53.912627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:53.914938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-33ff45c1-b378-4c28-b3c0-dd2d5183c9e7 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.224269 Jun 06 14:28:53.916040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 449/853] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:53 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:54.511657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3c3a2fb2-a562-4ce3-8d61-38b77004da2b tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8af45040>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:54.558811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3c3a2fb2-a562-4ce3-8d61-38b77004da2b tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 200 len: 286 microversion: 2.1 time: 0.052688 Jun 06 14:28:54.559741 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 405/854] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:54 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:54.940430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:54.941077 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:54.948335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:54.949354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:54.950854 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:54.951303 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:55.115501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:55.124400 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:55.125979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:55.127185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-18cbc938-428f-4ca5-83a9-cd38ed707398 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.190738 Jun 06 14:28:55.127751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 450/855] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:54 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:55.575558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-255e876d-f6ce-46bb-84d3-bcda976236de tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8af1bd30>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:55.620784 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-255e876d-f6ce-46bb-84d3-bcda976236de tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 200 len: 287 microversion: 2.1 time: 0.052055 Jun 06 14:28:55.621671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 406/856] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:55 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:28:55.635820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-26343d83-e2f4-4c94-bfce-58cfd460643b tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8a74ff70>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:55.723396 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-26343d83-e2f4-4c94-bfce-58cfd460643b tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 202 len: 0 microversion: 2.1 time: 0.094703 Jun 06 14:28:55.724325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 451/857] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jun 6 14:28:55 2022] DELETE /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:28:55.735728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8f49b36b-c8c6-4b63-8f4d-416b6afc05ef tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8af1b160>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:55.771123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8f49b36b-c8c6-4b63-8f4d-416b6afc05ef tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 200 len: 286 microversion: 2.1 time: 0.040955 Jun 06 14:28:55.772041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 407/858] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:55 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:56.147810 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:56.148421 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:56.158522 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:56.158980 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:56.159831 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:56.160278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:56.325581 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:56.335132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:56.336970 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:56.338343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bd9596f5-7a19-45fd-b01c-c15be2009a03 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1744 microversion: 2.20 time: 0.195036 Jun 06 14:28:56.340069 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 452/859] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:56 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:28:56.785077 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d62b6162-5e84-4131-a5ff-46426919700f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8af45670>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:56.827845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-d62b6162-5e84-4131-a5ff-46426919700f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] HTTP exception thrown: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d62b6162-5e84-4131-a5ff-46426919700f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Request method failure captured: Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 HTTP/1.1 Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing8iZiVQVt8y3PMCntL7cJkueijLVXy3hXOWd8zB_7ePYn_zcHmqXZBjf1KGmCAtApC0Ze8VAVsainG-L3OqYtOu8eiin_CcChpfZunvPrcd1slzs-OMBCp0OKm2pvbXN7DH49C92GxxAv1GnlW1MTc6XYXiDt6Dn_E2Y6dLlsu7KEc Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:28:56.831593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_594246afbcdc478d81b85c5b525ae1e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}] Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 2aeeaf8afea14478b96d2e8e4c77b9d7 Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '0aff67fa-9e50-473e-93a0-3f7f970c2018'} Jun 06 14:28:56.834025 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. (HTTP 404) (Request-ID: req-db19772b-5fd9-419d-b275-8ab86654844e) Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.835606 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:28:56.837676 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 06 14:28:56.840834 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d62b6162-5e84-4131-a5ff-46426919700f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Returning 404 to user: Snapshot 0aff67fa-9e50-473e-93a0-3f7f970c2018 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d62b6162-5e84-4131-a5ff-46426919700f tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018" status: 404 len: 111 microversion: 2.1 time: 0.054013 Jun 06 14:28:56.842968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 408/860] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 14:28:56 2022] GET /compute/v2.1/os-snapshots/0aff67fa-9e50-473e-93a0-3f7f970c2018 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:28:56.854097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4cfd4900-d826-4bc8-b3a8-cc12df940e71 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae900b3a60>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:56.927870 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4cfd4900-d826-4bc8-b3a8-cc12df940e71 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 202 len: 0 microversion: 2.1 time: 0.078453 Jun 06 14:28:56.928647 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 453/861] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:28:56 2022] DELETE /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:28:56.938139 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa8ccb0d-7ddc-4471-afcd-a8ebf4444dd4 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae94063f70>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:56.996199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fa8ccb0d-7ddc-4471-afcd-a8ebf4444dd4 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 200 len: 343 microversion: 2.1 time: 0.061998 Jun 06 14:28:56.997239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 409/862] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:28:56 2022] GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 343 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:28:57.360410 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:57.361065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:57.363349 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:28:57.374256 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:57.374968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:57.375950 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:57.376501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:57.534645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:57.545024 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:57.546673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:57.547910 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2904090f-4b04-41c9-af5c-21e67161a690 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1744 microversion: 2.20 time: 0.193295 Jun 06 14:28:57.548472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 454/863] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:57 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:58.013865 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03aff03e-bfac-4987-a925-f17588ea39e9 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8aff1820>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:58.055890 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-03aff03e-bfac-4987-a925-f17588ea39e9 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] HTTP exception thrown: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03aff03e-bfac-4987-a925-f17588ea39e9 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Request method failure captured: Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 HTTP/1.1 Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing8iZiVQVt8y3PMCntL7cJkueijLVXy3hXOWd8zB_7ePYn_zcHmqXZBjf1KGmCAtApC0Ze8VAVsainG-L3OqYtOu8eiin_CcChpfZunvPrcd1slzs-OMBCp0OKm2pvbXN7DH49C92GxxAv1GnlW1MTc6XYXiDt6Dn_E2Y6dLlsu7KEc Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:28:58.058537 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_594246afbcdc478d81b85c5b525ae1e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}] Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 2aeeaf8afea14478b96d2e8e4c77b9d7 Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'ac344360-a4af-47cb-8531-1d485a7e5844'} Jun 06 14:28:58.061403 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. (HTTP 404) (Request-ID: req-00334a28-26b9-49ce-adc7-fdc84f489163) Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.063277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:28:58.066786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 14:28:58.069207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03aff03e-bfac-4987-a925-f17588ea39e9 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Returning 404 to user: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-03aff03e-bfac-4987-a925-f17588ea39e9 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 404 len: 109 microversion: 2.1 time: 0.051897 Jun 06 14:28:58.071698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 410/864] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:28:58 2022] GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:28:58.076508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b1c4bc66-f798-4eea-8891-b656458b8097 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8a5c01f0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:58.113576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-b1c4bc66-f798-4eea-8891-b656458b8097 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] HTTP exception thrown: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b1c4bc66-f798-4eea-8891-b656458b8097 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Request method failure captured: Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 HTTP/1.1 Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing8iZiVQVt8y3PMCntL7cJkueijLVXy3hXOWd8zB_7ePYn_zcHmqXZBjf1KGmCAtApC0Ze8VAVsainG-L3OqYtOu8eiin_CcChpfZunvPrcd1slzs-OMBCp0OKm2pvbXN7DH49C92GxxAv1GnlW1MTc6XYXiDt6Dn_E2Y6dLlsu7KEc Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:28:58.115638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_594246afbcdc478d81b85c5b525ae1e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}] Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 2aeeaf8afea14478b96d2e8e4c77b9d7 Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'ac344360-a4af-47cb-8531-1d485a7e5844'} Jun 06 14:28:58.117628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. (HTTP 404) (Request-ID: req-d0b7ad92-752e-46e5-a533-446d396c5661) Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.119045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 14:28:58.121483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 14:28:58.125962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b1c4bc66-f798-4eea-8891-b656458b8097 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Returning 404 to user: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b1c4bc66-f798-4eea-8891-b656458b8097 tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 404 len: 109 microversion: 2.1 time: 0.046373 Jun 06 14:28:58.131429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 455/865] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:28:58 2022] DELETE /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:28:58.133386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-48fb3a90-fb33-4b87-a1ab-e711ecb7150a tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Calling method '.version_select at 0x7fae8aff10d0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:58.176135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-48fb3a90-fb33-4b87-a1ab-e711ecb7150a tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] HTTP exception thrown: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-48fb3a90-fb33-4b87-a1ab-e711ecb7150a tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Request method failure captured: Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 HTTP/1.1 Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing8iZiVQVt8y3PMCntL7cJkueijLVXy3hXOWd8zB_7ePYn_zcHmqXZBjf1KGmCAtApC0Ze8VAVsainG-L3OqYtOu8eiin_CcChpfZunvPrcd1slzs-OMBCp0OKm2pvbXN7DH49C92GxxAv1GnlW1MTc6XYXiDt6Dn_E2Y6dLlsu7KEc Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:28:58.180440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/594246afbcdc478d81b85c5b525ae1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_594246afbcdc478d81b85c5b525ae1e9", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/594246afbcdc478d81b85c5b525ae1e9"}]}] Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 594246afbcdc478d81b85c5b525ae1e9 Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-929840556 Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 2aeeaf8afea14478b96d2e8e4c77b9d7 Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotsTestJSON-929840556-project Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'ac344360-a4af-47cb-8531-1d485a7e5844'} Jun 06 14:28:58.183384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. (HTTP 404) (Request-ID: req-09dcc3c1-a89e-40a8-844a-83667593db79) Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.185045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:28:58.187401 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 14:28:58.189802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-48fb3a90-fb33-4b87-a1ab-e711ecb7150a tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] Returning 404 to user: Volume ac344360-a4af-47cb-8531-1d485a7e5844 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-48fb3a90-fb33-4b87-a1ab-e711ecb7150a tempest-VolumesSnapshotsTestJSON-929840556 tempest-VolumesSnapshotsTestJSON-929840556-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844" status: 404 len: 109 microversion: 2.1 time: 0.058451 Jun 06 14:28:58.192953 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 411/866] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:28:58 2022] GET /compute/v2.1/os-volumes/ac344360-a4af-47cb-8531-1d485a7e5844 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:28:58.573890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:58.577060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:58.592205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:58.592932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:58.594277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:58.595234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:58.840611 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:58.854949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:58.859762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:28:58.862695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-461666b5-f017-46e9-8c07-a9e15da2b8bf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.297422 Jun 06 14:28:58.869873 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 456/867] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:58 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:28:59.919453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:28:59.922036 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:28:59.937947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:59.939256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:28:59.941009 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:28:59.942239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:00.228082 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:00.237338 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:00.239402 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:00.240738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8bb5850d-919e-4a2e-be61-f4de55ea8b43 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.328822 Jun 06 14:29:00.241933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 412/868] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:28:59 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:00.696746 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ec17469b-3a6e-40f0-9f08-032c96beb916 req-125ca724-85a8-411f-b285-397f82ff57c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "name": "network-vif-plugged", "status": "completed", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:00.757794 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ec17469b-3a6e-40f0-9f08-032c96beb916 req-125ca724-85a8-411f-b285-397f82ff57c7 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:00.759717 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ec17469b-3a6e-40f0-9f08-032c96beb916 req-125ca724-85a8-411f-b285-397f82ff57c7 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:00.814740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ec17469b-3a6e-40f0-9f08-032c96beb916 req-125ca724-85a8-411f-b285-397f82ff57c7 service nova] Creating event network-vif-plugged:00be5767-88c2-478d-a1ae-cc4eac3793c2 for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a on hv-cinder-84414 Jun 06 14:29:00.827186 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ec17469b-3a6e-40f0-9f08-032c96beb916 req-125ca724-85a8-411f-b285-397f82ff57c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141996 Jun 06 14:29:00.828618 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 457/869] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:01.125328 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4bbc3f8d-785b-4881-97bf-2f26dbedc6b8 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Action: 'create', calling method: .version_select at 0x7fae8af55790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-562721927", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4bbc3f8d-785b-4881-97bf-2f26dbedc6b8 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Request method failure captured: Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 121 Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing8sZnPkdS1S2Fxp4c6kh2Y7fClZbZnJRf_9U18UfG68ENQqOyNiOSobLGPY8zLUvA-c6xej5VTU77vHgh1Ust2W7re45fMf3GvF3AQF7SfQPXG3KPXGEks1mn__NyG4KSjJ7OT2Qm7TBe9as2BIDz1GomJcvORmnFIBMQC7F6GFMaM Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:01.142364 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2abbae84ab74993b3b9910197746ce3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}] Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 088524c3a77a4c3d858e0b60117a0ada Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-562721927", "metadata": {"Type": "work"}}} Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: Jun 06 14:29:01.144107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-562721927', 'metadata': {'Type': 'work'}}}} Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise error Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi '#$%' Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:01.145069 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 14:29:01.146589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 14:29:01.147851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 14:29:01.147851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.150775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4bbc3f8d-785b-4881-97bf-2f26dbedc6b8 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:01.154400 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4bbc3f8d-785b-4881-97bf-2f26dbedc6b8 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.306373 Jun 06 14:29:01.155321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 413/870] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 14:29:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 14:29:01.169835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ef79ac74-fb10-4cc7-acaf-ec3189ce92b3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Action: 'create', calling method: .version_select at 0x7fae900515e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1952464827", "metadata": {"Type": "work"}}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ef79ac74-fb10-4cc7-acaf-ec3189ce92b3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Request method failure captured: Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 120 Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing8sZnPkdS1S2Fxp4c6kh2Y7fClZbZnJRf_9U18UfG68ENQqOyNiOSobLGPY8zLUvA-c6xej5VTU77vHgh1Ust2W7re45fMf3GvF3AQF7SfQPXG3KPXGEks1mn__NyG4KSjJ7OT2Qm7TBe9as2BIDz1GomJcvORmnFIBMQC7F6GFMaM Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:01.176715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2abbae84ab74993b3b9910197746ce3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}] Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 088524c3a77a4c3d858e0b60117a0ada Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1952464827", "metadata": {"Type": "work"}}} Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: Jun 06 14:29:01.178382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1952464827', 'metadata': {'Type': 'work'}}}} Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise error Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi '0' Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:01.179220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 14:29:01.180697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 14:29:01.183032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 14:29:01.183032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.184193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ef79ac74-fb10-4cc7-acaf-ec3189ce92b3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:01.185338 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ef79ac74-fb10-4cc7-acaf-ec3189ce92b3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021263 Jun 06 14:29:01.186439 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 458/871] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 14:29:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:29:01.196976 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-53302665-fe5e-49a9-9c10-7d04bd9e5ee3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Action: 'create', calling method: .version_select at 0x7fae90055700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1792727", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-53302665-fe5e-49a9-9c10-7d04bd9e5ee3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Request method failure captured: Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 116 Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing8sZnPkdS1S2Fxp4c6kh2Y7fClZbZnJRf_9U18UfG68ENQqOyNiOSobLGPY8zLUvA-c6xej5VTU77vHgh1Ust2W7re45fMf3GvF3AQF7SfQPXG3KPXGEks1mn__NyG4KSjJ7OT2Qm7TBe9as2BIDz1GomJcvORmnFIBMQC7F6GFMaM Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:01.202247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2abbae84ab74993b3b9910197746ce3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}] Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 088524c3a77a4c3d858e0b60117a0ada Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1792727", "metadata": {"Type": "work"}}} Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: Jun 06 14:29:01.203742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1792727', 'metadata': {'Type': 'work'}}}} Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise error Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi '' Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:01.204588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 14:29:01.206044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 14:29:01.207216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 14:29:01.207216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.209180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-53302665-fe5e-49a9-9c10-7d04bd9e5ee3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:01.210437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-53302665-fe5e-49a9-9c10-7d04bd9e5ee3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017545 Jun 06 14:29:01.211201 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 414/872] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 14:29:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:29:01.221654 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8adb8c34-5b19-45a5-9dee-11ab66292db4 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Calling method '.version_select at 0x7fae8a772d30>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:01.271195 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:01.271801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:01.284750 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:01.290061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-8adb8c34-5b19-45a5-9dee-11ab66292db4 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] HTTP exception thrown: Volume tempest-invalid-1751117070 could not be found. Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8adb8c34-5b19-45a5-9dee-11ab66292db4 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Request method failure captured: Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1751117070 HTTP/1.1 Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing8sZnPkdS1S2Fxp4c6kh2Y7fClZbZnJRf_9U18UfG68ENQqOyNiOSobLGPY8zLUvA-c6xej5VTU77vHgh1Ust2W7re45fMf3GvF3AQF7SfQPXG3KPXGEks1mn__NyG4KSjJ7OT2Qm7TBe9as2BIDz1GomJcvORmnFIBMQC7F6GFMaM Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:01.295094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2abbae84ab74993b3b9910197746ce3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}] Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 088524c3a77a4c3d858e0b60117a0ada Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Volume tempest-invalid-1751117070 could not be found. Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'tempest-invalid-1751117070'} Jun 06 14:29:01.298408 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1751117070 could not be found. (HTTP 404) (Request-ID: req-f41826c0-67d4-42e6-a28d-f5e4605cec18) Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.300883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 14:29:01.304579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1751117070 could not be found. Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:01.312393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1751117070 could not be found. Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1751117070 could not be found. Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8adb8c34-5b19-45a5-9dee-11ab66292db4 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Returning 404 to user: Volume tempest-invalid-1751117070 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:01.316447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8adb8c34-5b19-45a5-9dee-11ab66292db4 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1751117070" status: 404 len: 99 microversion: 2.1 time: 0.085012 Jun 06 14:29:01.318840 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:01.319086 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 459/873] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 14:29:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1751117070 => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 06 14:29:01.319318 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:01.319318 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:01.332304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cf9b953d-2934-4b81-b92c-4abc53df859a tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012012 Jun 06 14:29:01.337607 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 460/874] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jun 6 14:29:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 14:29:01.350703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d2b2b5d6-18e6-49f8-b8b5-fb793da69e7b tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010718 Jun 06 14:29:01.356633 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 461/875] 10.222.0.13 () {58 vars in 1136 bytes} [Mon Jun 6 14:29:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 14:29:01.362003 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e6cecb78-6c68-4871-8f6d-dbaa51b9fcc3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Calling method '.version_select at 0x7fae90051040>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:01.406268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-e6cecb78-6c68-4871-8f6d-dbaa51b9fcc3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] HTTP exception thrown: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e6cecb78-6c68-4871-8f6d-dbaa51b9fcc3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Request method failure captured: Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/os-volumes/024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 HTTP/1.1 Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing8sZnPkdS1S2Fxp4c6kh2Y7fClZbZnJRf_9U18UfG68ENQqOyNiOSobLGPY8zLUvA-c6xej5VTU77vHgh1Ust2W7re45fMf3GvF3AQF7SfQPXG3KPXGEks1mn__NyG4KSjJ7OT2Qm7TBe9as2BIDz1GomJcvORmnFIBMQC7F6GFMaM Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:01.408881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2abbae84ab74993b3b9910197746ce3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}] Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 088524c3a77a4c3d858e0b60117a0ada Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3'} Jun 06 14:29:01.410443 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. (HTTP 404) (Request-ID: req-50ed0eee-36fd-463d-a479-1a4189a2cf43) Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.411295 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 14:29:01.412492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 14:29:01.413695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. Jun 06 14:29:01.414904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.418019 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e6cecb78-6c68-4871-8f6d-dbaa51b9fcc3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Returning 404 to user: Volume 024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:01.419275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e6cecb78-6c68-4871-8f6d-dbaa51b9fcc3 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3" status: 404 len: 109 microversion: 2.1 time: 0.061578 Jun 06 14:29:01.420114 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 462/876] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:29:01 2022] DELETE /compute/v2.1/os-volumes/024e2a29-de91-4e0b-a37e-2e2d6c1dd2b3 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:01.438343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18fd280c-f3e3-4603-b2be-3b73e295dd66 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Calling method '.version_select at 0x7fae9006ab80>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:01.508809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-18fd280c-f3e3-4603-b2be-3b73e295dd66 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] HTTP exception thrown: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18fd280c-f3e3-4603-b2be-3b73e295dd66 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Request method failure captured: Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/os-volumes/9849ea0a-583e-425b-9287-11500093aa84 HTTP/1.1 Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing8sZnPkdS1S2Fxp4c6kh2Y7fClZbZnJRf_9U18UfG68ENQqOyNiOSobLGPY8zLUvA-c6xej5VTU77vHgh1Ust2W7re45fMf3GvF3AQF7SfQPXG3KPXGEks1mn__NyG4KSjJ7OT2Qm7TBe9as2BIDz1GomJcvORmnFIBMQC7F6GFMaM Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:01.514172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f2abbae84ab74993b3b9910197746ce3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f2abbae84ab74993b3b9910197746ce3", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f2abbae84ab74993b3b9910197746ce3"}]}] Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f2abbae84ab74993b3b9910197746ce3 Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-1294998962 Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 088524c3a77a4c3d858e0b60117a0ada Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-1294998962-project Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '9849ea0a-583e-425b-9287-11500093aa84'} Jun 06 14:29:01.516967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. (HTTP 404) (Request-ID: req-8d79d1ec-c4eb-4993-9d53-17b43ff33218) Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.518803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 14:29:01.521217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 14:29:01.525773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. Jun 06 14:29:01.528203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:01.531058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18fd280c-f3e3-4603-b2be-3b73e295dd66 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] Returning 404 to user: Volume 9849ea0a-583e-425b-9287-11500093aa84 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:01.533364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-18fd280c-f3e3-4603-b2be-3b73e295dd66 tempest-VolumesNegativeTest-1294998962 tempest-VolumesNegativeTest-1294998962-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9849ea0a-583e-425b-9287-11500093aa84" status: 404 len: 109 microversion: 2.1 time: 0.104904 Jun 06 14:29:01.535700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 463/877] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 14:29:01 2022] GET /compute/v2.1/os-volumes/9849ea0a-583e-425b-9287-11500093aa84 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:01.633321 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:01.654287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:01.657303 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:01.659495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0e18690e-b45f-44f4-add9-4645ca45f2f2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.392589 Jun 06 14:29:01.674350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 415/878] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:01 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:02.697201 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:02.699252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:02.708807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:02.709417 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:02.710425 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:02.710972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:02.946749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:02.964522 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:02.971318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:02.973170 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fd7199ed-8e6f-41e4-815c-8abb548135e3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.288430 Jun 06 14:29:02.978858 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 464/879] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:02 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:04.005023 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:04.007932 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:04.022758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:04.023957 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:04.026142 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:04.028477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:04.252179 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:04.268915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:04.275354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:04.279889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-93e46c3f-fef5-47f6-ba68-136e298c5862 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.282601 Jun 06 14:29:04.282014 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 416/880] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:03 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:05.317503 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:05.319681 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:05.332776 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:05.334161 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:05.336265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:05.337340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:05.734621 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:05.758468 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:05.765916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:05.768314 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-86f9430d-21dc-47b2-ad8c-524a0c5dbd33 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.457134 Jun 06 14:29:05.769543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 465/881] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:05 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:05.931026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:05.932311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:05.940993 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:05.941695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:05.943070 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:05.944101 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:05.992893 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-453c5fa2-1355-4802-95d7-ec2eb23cf5ea tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/ips" status: 200 len: 146 microversion: 2.1 time: 0.065429 Jun 06 14:29:05.993892 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 417/882] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:29:05 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/ips => generated 146 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:06.794132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:06.794761 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:06.821080 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:06.822349 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:06.824756 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:06.826891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:06.862729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=100 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:07.103173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:07.115560 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:07.118631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:07.121641 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a776fb76-dea1-4000-9c67-33a4999d6ef8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.331594 Jun 06 14:29:07.122897 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 466/883] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:06 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:07.640464 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f28862b-2f8b-4ec6-ab87-9332835b3061"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:07.643855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:07.657848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:07.661828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:07.663651 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:07.664674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:08.156377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:08.159805 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:08.194519 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:08.197608 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7a213548-02fd-4a64-a415-15747d4c0152 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567395 Jun 06 14:29:08.206731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:08.208108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:08.217026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 418/884] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:29:07 2022] POST /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:29:08.219060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:08.624132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:08.633022 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:08.634653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:08.636985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d25b9f2c-d9d3-46a7-ad1c-a585ea0bc9d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.488838 Jun 06 14:29:08.637558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 467/885] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:08 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:09.663896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:09.665612 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:09.684901 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:09.685460 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:09.686920 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:09.688011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:10.051181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:10.060622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:10.066760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:10.068446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-38557f7a-e12b-4f4a-84ca-46dd05cc52c3 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.415525 Jun 06 14:29:10.081510 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 419/886] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:09 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:11.099099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:11.101459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:11.149247 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:11.149939 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:11.150590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:11.151715 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:11.198960 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:11.200699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:11.226327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:11.226908 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:11.228126 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:11.228750 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:11.423374 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-73dd59e6-c1e6-41c0-83eb-59a73687a0c9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/action" status: 202 len: 0 microversion: 2.1 time: 0.229228 Jun 06 14:29:11.429089 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 420/887] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:29:11 2022] POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:29:11.438259 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:11.439431 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:11.446806 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:11.447640 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:11.449064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:11.449811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:11.454156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:11.464164 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:11.465695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:11.466938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-48c46e77-9511-47eb-8108-1ce919bce735 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1739 microversion: 2.20 time: 0.380469 Jun 06 14:29:11.471592 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 468/888] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:11 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:11.737177 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:11.748956 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dbdd5c6a-97cc-4a5f-8bb2-b353f677850c tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1751 microversion: 2.1 time: 0.315116 Jun 06 14:29:11.750905 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 421/889] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:11 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1751 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:12.493996 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:12.496670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:12.516979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:12.517972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:12.519937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:12.521142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:12.777353 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:12.778315 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:12.789203 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:12.789203 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:12.789561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:12.790040 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:12.796398 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:12.819514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:12.829857 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:12.834593 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3fe9f28c-f6ad-4db2-b2e9-6a61c7cefc5f tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1721 microversion: 2.20 time: 0.345556 Jun 06 14:29:12.837389 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 469/890] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:12 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1721 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:13.006821 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:13.020208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-35dcc008-fc1d-4399-bb6f-959bdc7f14e3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1751 microversion: 2.1 time: 0.247231 Jun 06 14:29:13.031973 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 422/891] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:12 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:13.864932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:13.865582 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:13.873518 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:13.873998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:13.874886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:13.875265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:14.034291 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:14.045196 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:14.047073 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:14.048454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4854cd5e-7a49-4018-98ad-38c945997ce8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1721 microversion: 2.20 time: 0.187680 Jun 06 14:29:14.049019 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 470/892] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:13 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:14.053533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:14.054730 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:14.058605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=28 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:14.065243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:14.065814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:14.066836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:14.067343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:14.239018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:14.249496 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e316122b-2a32-445c-9275-9052f2181eed tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.209152 Jun 06 14:29:14.250140 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 423/893] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:14 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:15.079472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:15.080331 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:15.090820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:15.091694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:15.093126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:15.094060 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:15.247759 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:15.256101 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:15.257855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:15.259267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d445249b-9468-4826-be8b-b0d6b27107d2 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1721 microversion: 2.20 time: 0.183794 Jun 06 14:29:15.260079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 471/894] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:15 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:29:15.268495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:15.269275 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:15.277375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:15.278108 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:15.278913 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:15.279350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:15.533271 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:15.543479 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66550ed2-42c8-48a1-acd5-9bfc9d788fb5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.279322 Jun 06 14:29:15.544082 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 424/895] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:15 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:16.282260 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:16.283231 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:16.296438 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.296990 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.298364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.299216 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.323707 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:16.325341 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:16.335493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.336240 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.337596 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.339015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.394158 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3b4cbb6c-e9ab-4088-bd0e-aecf9e45e430 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075479 Jun 06 14:29:16.395320 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 425/896] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:29:16 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:16.412731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:16.413184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:16.423873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.424367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.425210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.425690 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.470570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:16.477462 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-78827750-a603-4ff0-93cd-a751303c0751 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/4f28862b-2f8b-4ec6-ab87-9332835b3061" status: 200 len: 194 microversion: 2.1 time: 0.072070 Jun 06 14:29:16.482228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 426/897] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 6 14:29:16 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/4f28862b-2f8b-4ec6-ab87-9332835b3061 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:29:16.563996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:16.565525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:16.574330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.575199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.576540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.577238 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.618177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:16.636918 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:16.640774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:16.643669 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-524a1b36-f172-4af1-890a-6bbd7f41cd36 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1664 microversion: 2.20 time: 0.368440 Jun 06 14:29:16.645300 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 472/898] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:16 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1664 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:16.679942 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86b4b694-9b50-4d0e-b29b-f64fac263b9e"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:16.681628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:16.691580 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.692437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.693932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:16.694993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:16.981698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:17.001899 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-21439303-9731-4b49-8566-cc62b3a05647 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.442585 Jun 06 14:29:17.004883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 427/899] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:16 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:17.027335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-4408c878-ebcb-4a86-875a-93b0faf9df80 req-8b4d7751-3ad7-4ea4-bb23-6f7adf6001eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "name": "network-vif-unplugged", "status": "completed", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:17.052690 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-4408c878-ebcb-4a86-875a-93b0faf9df80 req-8b4d7751-3ad7-4ea4-bb23-6f7adf6001eb service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:17.053879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-4408c878-ebcb-4a86-875a-93b0faf9df80 req-8b4d7751-3ad7-4ea4-bb23-6f7adf6001eb service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:17.083029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.compute.server_external_events [req-4408c878-ebcb-4a86-875a-93b0faf9df80 req-8b4d7751-3ad7-4ea4-bb23-6f7adf6001eb service nova] Unable to find a host for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a. Dropping event network-vif-unplugged {{(pid=117604) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 14:29:17.084525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-4408c878-ebcb-4a86-875a-93b0faf9df80 req-8b4d7751-3ad7-4ea4-bb23-6f7adf6001eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077193 Jun 06 14:29:17.085554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 428/900] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 80 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 14:29:17.417326 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-89232fad-3986-4092-ba1a-753c08b6dca4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.742540 Jun 06 14:29:17.418525 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 473/901] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jun 6 14:29:16 2022] POST /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-volume_attachments => generated 188 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 14:29:17.571790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:17.572495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:17.580346 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:17.580996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:17.582061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:17.582554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:17.892753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b6a8b9ad-fb21-47ba-b456-2588432835c4 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-volume_attachments/86b4b694-9b50-4d0e-b29b-f64fac263b9e" status: 202 len: 0 microversion: 2.20 time: 0.324885 Jun 06 14:29:17.897554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 429/902] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jun 6 14:29:17 2022] DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-volume_attachments/86b4b694-9b50-4d0e-b29b-f64fac263b9e => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 14:29:17.957666 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:17.958467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:17.965682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:17.966189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:17.967031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:17.967495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.023445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:18.024090 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:18.032841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:18.033285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.034112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:18.034547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.102807 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fd9b1607-9f77-4276-800a-7f945ec47f80 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "POST /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/action" status: 202 len: 0 microversion: 2.20 time: 0.149343 Jun 06 14:29:18.105148 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 474/903] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 14:29:17 2022] POST /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:29:18.117046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:18.118006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:18.128993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:18.129700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.130935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:18.132109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.297558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:18.314801 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aebe7bd2-cca8-4a7a-b257-b814d301888e tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.295500 Jun 06 14:29:18.316375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 430/904] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:18 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:18.332083 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc74e1c9-362b-49b7-b081-72e71f5e5bb6"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:18.335593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:18.349633 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:18.350541 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.352032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:18.352878 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:18.380963 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:18.398311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:18.402709 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:18.404953 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4b86a7de-180e-4004-9ebf-d3586fa9d28b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1672 microversion: 2.20 time: 0.293449 Jun 06 14:29:18.406049 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 475/905] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:18 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1672 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:18.773036 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-45772a96-3d41-40fa-8b05-ac7bf0ba403e tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "POST /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454574 Jun 06 14:29:18.774033 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 431/906] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:29:18 2022] POST /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:19.346273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:19.347339 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:19.366189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:19.367339 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:19.369300 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:19.370903 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:19.430437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:19.431367 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:19.439764 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:19.440335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:19.441442 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:19.442023 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:19.803587 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:19.821046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-86ee550b-e2f8-437c-a31b-b0d2f87ab139 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.478794 Jun 06 14:29:19.834290 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:19.835107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 476/907] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:19 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:19.849979 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:19.851847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:19.853196 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5e547cbe-8326-413b-a82b-672b093df923 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.430452 Jun 06 14:29:19.866078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 432/908] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:19 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:20.856115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:20.859436 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:20.873800 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:20.874920 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:20.875301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:20.876242 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:20.877893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:20.878744 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:20.882701 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:20.883151 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:20.884131 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:20.884574 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:21.218814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:21.247071 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:21.250475 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:21.253004 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bc96a132-b394-48a9-ad56-856b3a3f527e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.383700 Jun 06 14:29:21.262187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 433/909] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:20 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:29:21.269040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:21.285866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-81cbd980-19e0-4da4-893e-d603d3126ed5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.440423 Jun 06 14:29:21.286955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 477/910] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:20 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:21.345421 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:21.345966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:21.374841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:21.376066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:21.379539 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:21.381206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:21.439178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6db671e2-f365-44f2-a209-007816896df6 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/ips" status: 200 len: 150 microversion: 2.1 time: 0.099816 Jun 06 14:29:21.440188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 434/911] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 14:29:21 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:22.293922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:22.295700 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:22.305738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:22.306659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:22.308415 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:22.309161 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:22.319607 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:22.321070 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:22.338802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:22.340188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:22.344669 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:22.345524 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:22.727787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:22.734009 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:22.743933 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-80357df9-a79a-489f-aa60-22e0e3bccc39 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.428993 Jun 06 14:29:22.757051 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:22.758523 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 435/912] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:22 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:22.772889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:22.772889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-07994937-7c32-4578-80ce-79c888a6207b tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.481958 Jun 06 14:29:22.772889 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 478/913] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:22 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:23.374325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7247a214-76c3-42a8-afe3-4eedf6e93f91"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:23.377527 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:23.390435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:23.391590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:23.393186 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:23.394183 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:23.425040 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:23.786555 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:23.793395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:23.812001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:23.812744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:23.819665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:23.820618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:24.159002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:24.179434 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6c6ed23d-efe8-48b1-ba87-fbb0037dc0c6 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.396595 Jun 06 14:29:24.180903 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 436/914] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:23 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:24.190723 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:24.191599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:24.203127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:24.204282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:24.205682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:24.206478 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:24.509350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:24.519230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:24.521248 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:24.522776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7d498077-ee12-4ebb-8551-aac83a30c703 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.340141 Jun 06 14:29:24.523567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 437/915] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:24 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:25.218091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:25.218091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:25.234667 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:25.235664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:25.237501 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:25.238325 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:25.637041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:25.667026 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-62ab3722-dd52-44fc-837f-d1eb0ee879f2 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.460309 Jun 06 14:29:25.669657 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 438/916] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:25 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:25.692473 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:25.695153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:25.719732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:25.720451 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:25.721601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:25.722297 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:26.007156 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:26.018966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:26.021088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:26.022706 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5fe74ec0-0a2e-4dda-b109-67806e49daaf tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.349725 Jun 06 14:29:26.024109 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 439/917] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:25 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:26.699273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:26.700493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:26.717943 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:26.719371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:26.721041 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:26.722106 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:26.757738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:26.971224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:26.983597 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-47b12674-78d0-4ae0-a998-50be7399fede tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.292742 Jun 06 14:29:26.984715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 440/918] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:26 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:27.051006 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:27.051804 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:27.060042 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:27.060793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:27.062350 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:27.062961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:27.291831 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:27.302511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:27.303656 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:27.305059 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-41fb4987-d81c-491f-a085-c5d2578147f1 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.260491 Jun 06 14:29:27.305788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 441/919] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:27 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:29:28.006986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:28.008446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:28.018719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:28.019631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:28.020643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:28.021430 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:28.324731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:28.335772 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-96d57e70-35b1-461d-9027-8590677e28ec tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.333456 Jun 06 14:29:28.346624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 442/920] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:27 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:28.351906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:28.352650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:28.362520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:28.362520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:28.362520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:28.364330 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:28.687592 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:28.702462 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:28.709385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:28.709385 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-559ddad7-e153-4865-82b7-5974eb90fea0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.361076 Jun 06 14:29:28.710504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 443/921] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:28 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:29.357616 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:29.358368 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:29.365775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:29.366532 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:29.367339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:29.367773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:29.552718 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:29.561175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c5e932be-cde7-4e56-9387-a3c6585dde73 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1756 microversion: 2.1 time: 0.210759 Jun 06 14:29:29.562095 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 444/922] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:29 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:29.732863 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:29.733893 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:29.741854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:29.742529 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:29.743671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:29.746850 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:29.928938 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:29.939042 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:29.940580 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:29.941849 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e50d08a9-2130-40f1-8d44-259620d8f62e tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.216681 Jun 06 14:29:29.942665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 445/923] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:29 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:29:30.476482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-da0bb418-9b3b-4d12-801a-822a6e41a88b tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "POST /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.110259 Jun 06 14:29:30.477452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 479/924] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 14:29:23 2022] POST /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments => generated 194 bytes in 7113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:30.586987 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:30.586987 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:30.595848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:30.596634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:30.597668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:30.598275 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:30.864736 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:30.877343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-02ae1601-461a-433c-8ca6-76fe99f917e5 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1759 microversion: 2.1 time: 0.299996 Jun 06 14:29:30.879954 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 446/925] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:30 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1759 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:30.970501 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:30.971709 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:30.974677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=40 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:30.986018 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:30.986876 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:30.987955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:30.988588 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:31.203596 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:31.226228 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:31.230258 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:31.231930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fa0fd181-f7d0-4e56-95ac-a5ff55b5a9ce tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.270293 Jun 06 14:29:31.232959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 480/926] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:30 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:32.254642 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:32.255680 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:32.309982 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.311438 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.313052 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.313957 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.376252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:32.377301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:32.385038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.385506 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.386345 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.386788 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.426183 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-29ae2350-6e92-4888-a544-7f96d129ea3f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053759 Jun 06 14:29:32.427138 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 481/927] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:29:32 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:29:32.535007 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:32.546125 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:32.548808 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:32.550858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f1ccb2ca-76ff-48ef-b417-09984f111c73 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.302924 Jun 06 14:29:32.551809 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 447/928] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:32 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 14:29:32.571567 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:32.572803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:32.580490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.581038 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.581952 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.582388 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.629182 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-16add599-27f2-40cf-9639-cdbe238e6222 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/4f28862b-2f8b-4ec6-ab87-9332835b3061" status: 200 len: 194 microversion: 2.1 time: 0.064674 Jun 06 14:29:32.629765 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 482/929] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 6 14:29:32 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/4f28862b-2f8b-4ec6-ab87-9332835b3061 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:29:32.643687 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:32.644197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:32.652033 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.652861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.654064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:32.654531 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:32.764224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lazy-loading 'services' on Instance uuid 9ad1d56f-357d-443c-a043-471ab99f59e6 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:29:32.861548 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ac8143d7-6a11-48d5-b81f-a94707cdf777 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/4f28862b-2f8b-4ec6-ab87-9332835b3061" status: 202 len: 0 microversion: 2.1 time: 0.224446 Jun 06 14:29:32.862208 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 448/930] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:29:32 2022] DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/4f28862b-2f8b-4ec6-ab87-9332835b3061 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:29:33.578476 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:33.579001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:33.586864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:33.587358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:33.588459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:33.589492 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:33.796869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:33.806194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:33.808351 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:33.809574 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-aa812b26-c67a-4a3d-b68f-4a4bbd5cc0d0 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.235141 Jun 06 14:29:33.810177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 483/931] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:33 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:34.834600 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:34.835975 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:34.848448 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:34.849150 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:34.850511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:34.851525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:35.049072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:35.063127 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:35.065066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:35.066749 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0fe02f46-386e-4104-835b-f704078e83d8 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.240358 Jun 06 14:29:35.068042 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 449/932] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:34 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:36.089419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:36.090088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:36.099001 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:36.099741 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:36.101073 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:36.101847 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:36.252484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:36.261329 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:36.262898 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:36.264161 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2cba0575-ec9e-4cfc-af1a-0cad6d997d8a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.179811 Jun 06 14:29:36.264740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 484/933] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:36 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:36.899803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-e8fe2ea7-14c6-421e-8fa6-8b5e5428b03f req-2c5ef677-9bd7-4743-83a5-4bd1d0988912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "name": "network-vif-plugged", "status": "completed", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:36.918544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e8fe2ea7-14c6-421e-8fa6-8b5e5428b03f req-2c5ef677-9bd7-4743-83a5-4bd1d0988912 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:36.919210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e8fe2ea7-14c6-421e-8fa6-8b5e5428b03f req-2c5ef677-9bd7-4743-83a5-4bd1d0988912 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:36.932582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-e8fe2ea7-14c6-421e-8fa6-8b5e5428b03f req-2c5ef677-9bd7-4743-83a5-4bd1d0988912 service nova] Creating event network-vif-plugged:00be5767-88c2-478d-a1ae-cc4eac3793c2 for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a on hv-cinder-84414 Jun 06 14:29:36.938539 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-e8fe2ea7-14c6-421e-8fa6-8b5e5428b03f req-2c5ef677-9bd7-4743-83a5-4bd1d0988912 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045616 Jun 06 14:29:36.939178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 450/934] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:37.285129 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:37.286131 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:37.298493 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:37.299653 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:37.300758 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:37.301245 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:37.456241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:37.473908 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:37.475452 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:37.476644 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d9c4be87-412e-4711-b203-fae050912741 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.197186 Jun 06 14:29:37.477218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 485/935] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:37 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:38.504088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:38.505003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:38.514597 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:38.515046 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:38.515964 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:38.516518 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:38.736713 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:38.751395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:38.753949 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:38.755926 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-623dc6da-329d-4e25-8e1b-21c6b65af594 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1730 microversion: 2.20 time: 0.260418 Jun 06 14:29:38.756922 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 451/936] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:38 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:39.808280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:39.810484 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:39.836382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:39.837183 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:39.841078 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:39.842208 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:40.076792 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:40.085787 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:40.087399 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:40.088601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2f00e0a8-969d-4083-934c-fcf6b64c09af tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1717 microversion: 2.20 time: 0.306106 Jun 06 14:29:40.089181 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 486/937] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:29:39 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1717 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:29:40.495729 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:40.498731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:40.517483 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:40.518353 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:40.520967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:40.521567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:40.694261 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'services' on Instance uuid f31d82d4-d308-4faf-a71d-275dd69a615e {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:29:40.793622 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6e5a7228-d3da-4a3f-b1d3-659db1064873 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments/7247a214-76c3-42a8-afe3-4eedf6e93f91" status: 202 len: 0 microversion: 2.1 time: 0.313689 Jun 06 14:29:40.795162 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 452/938] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:29:40 2022] DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments/7247a214-76c3-42a8-afe3-4eedf6e93f91 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:29:40.806673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:40.807353 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:40.815514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:40.816943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:40.817884 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:40.818397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:40.864139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-388a945b-e889-4270-94c0-2c4bc256d65c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062898 Jun 06 14:29:40.868222 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 487/939] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:29:40 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:29:41.645375 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:41.646369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:41.656763 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:41.657603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:41.658542 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:41.659117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:41.715848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a9812fb2-2388-4db4-b279-d5fae01138e1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/fc74e1c9-362b-49b7-b081-72e71f5e5bb6" status: 200 len: 194 microversion: 2.1 time: 0.079120 Jun 06 14:29:41.716887 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 453/940] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 6 14:29:41 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/fc74e1c9-362b-49b7-b081-72e71f5e5bb6 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:41.732431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:41.732937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:41.741814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:41.742568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:41.744797 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:41.745627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:41.874631 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lazy-loading 'services' on Instance uuid 9ad1d56f-357d-443c-a043-471ab99f59e6 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:29:41.880429 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:41.882174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:41.893810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:41.894484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:41.896327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:41.897535 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:41.951064 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1fd0d215-03e5-4eda-87eb-90f42717f4e7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078377 Jun 06 14:29:41.953897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 454/941] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:29:41 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 14:29:41.997279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3504b45f-3be1-437e-9cce-d1384e9f0ea1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/fc74e1c9-362b-49b7-b081-72e71f5e5bb6" status: 202 len: 0 microversion: 2.1 time: 0.270479 Jun 06 14:29:41.998314 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 488/942] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:29:41 2022] DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments/fc74e1c9-362b-49b7-b081-72e71f5e5bb6 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:29:42.059175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:42.060003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:42.067165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:42.067809 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:42.068395 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:42.068833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:42.113585 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:29:42.145409 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:42.202526 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a6b4d6a3-7d68-4d74-8fc5-3d1780865029 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 204 len: 0 microversion: 2.1 time: 0.150636 Jun 06 14:29:42.203236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 455/943] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:42 2022] DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:29:42.212818 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:42.213926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:42.221090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:42.221602 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:42.222556 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:42.223192 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:42.429773 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:42.448834 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6a890d85-3263-4205-b462-33d122a6435f tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1681 microversion: 2.1 time: 0.240499 Jun 06 14:29:42.450075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 489/944] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:42 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:43.470032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:43.470728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:43.477830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:43.478940 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:43.480249 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:43.480782 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:43.639034 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:43.647017 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a65578fa-de1e-46a1-bc48-d98027eeb0e3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1681 microversion: 2.1 time: 0.182725 Jun 06 14:29:43.647836 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 456/945] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:43 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:44.667003 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:44.669006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:44.678070 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:44.678937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:44.680147 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:44.681097 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:44.956529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:44.977429 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-09d88410-96d3-4589-9e05-58956453fe5a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1681 microversion: 2.1 time: 0.315306 Jun 06 14:29:44.997804 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 490/946] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:44 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1681 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:45.388820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ea8c8481-d797-47e2-aee5-8710744483e7 req-69056094-5d43-47bd-9c24-e945965b0fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31d82d4-d308-4faf-a71d-275dd69a615e", "name": "network-vif-deleted", "tag": "54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:45.414910 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:45.418847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ea8c8481-d797-47e2-aee5-8710744483e7 req-69056094-5d43-47bd-9c24-e945965b0fe6 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:45.420388 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ea8c8481-d797-47e2-aee5-8710744483e7 req-69056094-5d43-47bd-9c24-e945965b0fe6 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:45.455838 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ea8c8481-d797-47e2-aee5-8710744483e7 req-69056094-5d43-47bd-9c24-e945965b0fe6 service nova] Creating event network-vif-deleted:54eefa90-9f94-4ed2-bf4a-e8bd9973a2a1 for instance f31d82d4-d308-4faf-a71d-275dd69a615e on hv-cinder-84414 Jun 06 14:29:45.473845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-ea8c8481-d797-47e2-aee5-8710744483e7 req-69056094-5d43-47bd-9c24-e945965b0fe6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089867 Jun 06 14:29:45.477440 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 457/947] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:29:45.478379 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:45.485199 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:45.515446 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:45.516186 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:45.517172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:45.517822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:45.589937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9a4a2bfa-26c2-4096-abc1-681d5014eaaf tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116683 Jun 06 14:29:45.592340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 491/948] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:29:45 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:29:45.861885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:45.864186 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:45.876567 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:45.877634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:45.879380 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:45.880103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:45.918425 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d70996c5-df2e-48d1-888a-778159c5776a tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064491 Jun 06 14:29:45.924664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 458/949] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:29:45 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 14:29:46.007225 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:46.008665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:46.015307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:46.016201 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:46.031148 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.032074 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.033413 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.033939 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.034684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.035411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.036487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.040201 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.098812 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:29:46.129864 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.130867 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.134098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lazy-loading 'fault' on Instance uuid f31d82d4-d308-4faf-a71d-275dd69a615e {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:29:46.211712 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53505ac8ab6142a6bf0c3d6fe1cc721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f185078fd436428e818d6dba472bacb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:46.224066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a2dc4d1d-7baf-4d0c-81d4-c143b4f756f7 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 200 len: 1331 microversion: 2.1 time: 0.219882 Jun 06 14:29:46.230009 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 492/950] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:46 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 1331 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:46.289087 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a3eab9f7-3410-4826-b270-46013d45e8a9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 204 len: 0 microversion: 2.1 time: 0.277291 Jun 06 14:29:46.291282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 459/951] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:46 2022] DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:29:46.303748 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:46.304394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:46.312126 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.312766 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.313972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:46.314660 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:46.526673 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:46.529205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:29:46.556470 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ae55bb36-fdb5-400e-95d4-c52d3f083eed tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1674 microversion: 2.1 time: 0.259562 Jun 06 14:29:46.567806 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 493/952] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:46 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1674 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:47.249164 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:47.250545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:47.259113 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:47.259885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:47.260883 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:47.261394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:47.277777 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e HTTP/1.1 Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:47.280002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:47.283165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'f31d82d4-d308-4faf-a71d-275dd69a615e'} Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:47.285049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:47.288013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:47.292245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:47.292245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1302646d-2eca-4d36-90e3-437d4c1e5423 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 404 len: 111 microversion: 2.1 time: 0.038312 Jun 06 14:29:47.292245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 460/953] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:47 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:47.292704 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d709ed8e-313c-48dd-ba70-bdd97b30767d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '.version_select at 0x7fae8a7145e0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:47.320172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d709ed8e-313c-48dd-ba70-bdd97b30767d tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-461600363" status: 202 len: 0 microversion: 2.1 time: 0.033571 Jun 06 14:29:47.320754 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 494/954] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 14:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-461600363 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:29:47.579112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:47.580320 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:47.587420 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:47.588464 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:47.589516 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:47.590219 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:48.068365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:48.086243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-42b34ace-da54-48f1-98c9-bd6cb046baa9 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1674 microversion: 2.1 time: 0.510900 Jun 06 14:29:48.101544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 461/955] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:47 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1674 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:49.124654 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:49.126490 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:49.142171 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:49.144032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:49.145986 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:49.146901 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:49.373275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:49.383280 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-54597ceb-b145-45c7-beb5-5c907d6790c1 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1674 microversion: 2.1 time: 0.277093 Jun 06 14:29:49.384420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 495/956] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:49 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1674 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:29:49.941089 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:49.942617 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:49.950620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:49.952002 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:49.952947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:49.953742 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:49.970680 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e HTTP/1.1 Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:49.972294 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:49.974076 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'f31d82d4-d308-4faf-a71d-275dd69a615e'} Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:49.975056 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:49.976470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:49.980182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:49.981145 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-98ae9739-3487-4f67-949d-2ed0f1723797 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 404 len: 111 microversion: 2.1 time: 0.044894 Jun 06 14:29:49.982058 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 462/957] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:49 2022] DELETE /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:50.000273 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:50.002363 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: f31d82d4-d308-4faf-a71d-275dd69a615e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:50.028332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:50.029142 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:50.030645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:50.031721 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:50.062335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e HTTP/1.1 Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:50.066275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:50.068757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'f31d82d4-d308-4faf-a71d-275dd69a615e'} Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:50.076207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. Jun 06 14:29:50.078718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:50.081123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance f31d82d4-d308-4faf-a71d-275dd69a615e could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:50.081123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-427a0be8-28af-4fae-b9a5-ec626e5ebaee tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e" status: 404 len: 111 microversion: 2.1 time: 0.080577 Jun 06 14:29:50.081123 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 496/958] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:49 2022] GET /compute/v2.1/servers/f31d82d4-d308-4faf-a71d-275dd69a615e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:50.408631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:50.409258 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:50.418783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:50.423668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:50.424823 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:50.425468 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:50.579393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f2e1c5d022c4bde9e76b8a933739557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41996fbf4ab4b81bc47ac29252ec762', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:29:50.594895 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-69aba9ae-6cd1-4278-a610-dea97bdd315d tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 200 len: 1606 microversion: 2.1 time: 0.189901 Jun 06 14:29:50.595753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 463/959] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:50 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 1606 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:29:50.653006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-b0200ca2-2811-4d1d-ac17-0c8f577ae596 req-c9e4dfd5-8284-48dc-aece-6d47874d6140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad1d56f-357d-443c-a043-471ab99f59e6", "name": "network-vif-deleted", "tag": "569a35d2-8e05-47d7-a517-e0725926092d"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:29:50.685589 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b0200ca2-2811-4d1d-ac17-0c8f577ae596 req-c9e4dfd5-8284-48dc-aece-6d47874d6140 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:50.686628 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-b0200ca2-2811-4d1d-ac17-0c8f577ae596 req-c9e4dfd5-8284-48dc-aece-6d47874d6140 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:50.742645 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-b0200ca2-2811-4d1d-ac17-0c8f577ae596 req-c9e4dfd5-8284-48dc-aece-6d47874d6140 service nova] Creating event network-vif-deleted:569a35d2-8e05-47d7-a517-e0725926092d for instance 9ad1d56f-357d-443c-a043-471ab99f59e6 on hv-cinder-84414 Jun 06 14:29:50.758342 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-b0200ca2-2811-4d1d-ac17-0c8f577ae596 req-c9e4dfd5-8284-48dc-aece-6d47874d6140 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113111 Jun 06 14:29:50.760151 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 497/960] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:29:51.355342 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:51.356229 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:51.370727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.378495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.379803 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.380679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.410212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc HTTP/1.1 Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:51.419796 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.422737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '384c1cd6-c5eb-4375-a766-77ca6bd1b4fc'} Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:51.424319 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.427028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.429787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:51.429787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ed28868b-543a-4479-aafe-cb0a91fff0f3 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 404 len: 111 microversion: 2.1 time: 0.071467 Jun 06 14:29:51.429787 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 464/961] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:51 2022] DELETE /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:29:51.435367 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:51.436073 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:51.445869 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.446328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.447175 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.447623 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.492454 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc HTTP/1.1 Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:51.498036 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.500725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '384c1cd6-c5eb-4375-a766-77ca6bd1b4fc'} Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:51.504318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. Jun 06 14:29:51.508871 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.516558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance 384c1cd6-c5eb-4375-a766-77ca6bd1b4fc could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:51.519066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-437b229e-223a-4ae6-90bf-3a0f3b96457a tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc" status: 404 len: 111 microversion: 2.1 time: 0.089262 Jun 06 14:29:51.526806 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 498/962] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:51 2022] GET /compute/v2.1/servers/384c1cd6-c5eb-4375-a766-77ca6bd1b4fc => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:51.533277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:51.533998 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:51.554003 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.558553 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.560466 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.561682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.590487 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f HTTP/1.1 Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:51.592163 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.595747 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '9df4fe33-1d83-4d2c-ab48-dbdd31902a0f'} Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:51.597369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.602298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.605453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:51.605453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3e02f0a5-19bf-4565-a7df-e4c326d54c9c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 404 len: 111 microversion: 2.1 time: 0.067058 Jun 06 14:29:51.605453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 465/963] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:51 2022] DELETE /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:51.614903 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:51.615539 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:51.617762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:51.620497 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:51.629823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.630697 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.631778 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.632514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.636419 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.637072 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.638433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:51.641181 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:51.666620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f HTTP/1.1 Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:51.672217 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.673682 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '9df4fe33-1d83-4d2c-ab48-dbdd31902a0f'} Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:51.674474 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. Jun 06 14:29:51.675728 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.679156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance 9df4fe33-1d83-4d2c-ab48-dbdd31902a0f could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:51.679156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f26117bb-66c6-450e-bf09-11a694bb8cd1 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f" status: 404 len: 111 microversion: 2.1 time: 0.065243 Jun 06 14:29:51.679156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 499/964] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:51 2022] GET /compute/v2.1/servers/9df4fe33-1d83-4d2c-ab48-dbdd31902a0f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:51.679377 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] HTTP exception thrown: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Request method failure captured: Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 HTTP/1.1 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2vH9sXMgnwFAp1rHjb6T0-nCT1PBhlYy8qEzbjDwWbkQM9paAf2dcPpQnNkUkVzSTYTStFu6UQk5ncxUoyIsUJxdD3XKBSRHuZfVf3PNtRsgxXphcQIUl7WQPZQbxUEAG7QU-UTyRG0RM7Ug_5F_mgBZmcMv8Ph3mfnWEW7zf7ah4 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:51.686727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c41996fbf4ab4b81bc47ac29252ec762", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}] Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 3f2e1c5d022c4bde9e76b8a933739557 Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:51.688173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '9ad1d56f-357d-443c-a043-471ab99f59e6'} Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:51.689049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:51.690348 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:51.691477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Returning 404 to user: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:51.691477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aebf1960-9df6-4a03-92d7-1b9527e76b1c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 404 len: 111 microversion: 2.1 time: 0.078332 Jun 06 14:29:51.691477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 466/965] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:51 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 14:29:51.706456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dab136e8-5a7f-49c6-b81e-f3cbf62c34de tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '.version_select at 0x7fae8a714430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:51.768066 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dab136e8-5a7f-49c6-b81e-f3cbf62c34de tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196715169" status: 202 len: 0 microversion: 2.1 time: 0.068917 Jun 06 14:29:51.773028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 500/966] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 14:29:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196715169 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 14:29:53.086718 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:53.089884 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:53.105741 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:53.106453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:53.108835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:53.109654 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:53.155032 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 HTTP/1.1 Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:53.160138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.163187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'a01d925b-d495-41e1-8810-5c4a905137f7'} Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:53.165230 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.167589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.174453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:53.174453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2dbd2acc-d8e8-4fdb-9076-4db1a69d14f9 tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 404 len: 111 microversion: 2.1 time: 0.084599 Jun 06 14:29:53.175015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 467/967] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:53 2022] DELETE /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:53.185390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:53.186193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] [instance: a01d925b-d495-41e1-8810-5c4a905137f7] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:53.195401 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:53.195849 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:53.197958 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:53.198703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:53.219927 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] HTTP exception thrown: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Request method failure captured: Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 HTTP/1.1 Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2jE0LNyX1LaKgQXPqt9zBJaPShv1txmCt3JI9vzLwkCrHPvqRKeLwiSJcmolW3GIlu_67iLyZnNQoBBvBYIX7T-oshmzq057HvILPLmJSG8zJvoLSy0zvcqY61OHMfzslptrDTqayhyG3SqjfyBVJKCjQTKdAfQ6dxqRE_I32VFtM Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:53.223277 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f185078fd436428e818d6dba472bacb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f185078fd436428e818d6dba472bacb8", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f185078fd436428e818d6dba472bacb8"}]}] Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: f185078fd436428e818d6dba472bacb8 Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1840098719 Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 53505ac8ab6142a6bf0c3d6fe1cc721f Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-1840098719-project Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.224843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'a01d925b-d495-41e1-8810-5c4a905137f7'} Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:53.225862 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. Jun 06 14:29:53.227375 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:53.228854 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] Returning 404 to user: Instance a01d925b-d495-41e1-8810-5c4a905137f7 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:53.230203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5f06a6dd-0d1a-49ea-af48-b1e58f11617c tempest-AttachVolumeNegativeTest-1840098719 tempest-AttachVolumeNegativeTest-1840098719-project] 10.222.0.13 "GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7" status: 404 len: 111 microversion: 2.1 time: 0.052908 Jun 06 14:29:53.231191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 501/968] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:53 2022] GET /compute/v2.1/servers/a01d925b-d495-41e1-8810-5c4a905137f7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:55.711092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:55.717115 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:55.744444 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:55.745864 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:55.747877 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:55.759479 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:55.813355 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] HTTP exception thrown: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Request method failure captured: Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 HTTP/1.1 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2vH9sXMgnwFAp1rHjb6T0-nCT1PBhlYy8qEzbjDwWbkQM9paAf2dcPpQnNkUkVzSTYTStFu6UQk5ncxUoyIsUJxdD3XKBSRHuZfVf3PNtRsgxXphcQIUl7WQPZQbxUEAG7QU-UTyRG0RM7Ug_5F_mgBZmcMv8Ph3mfnWEW7zf7ah4 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:55.820739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c41996fbf4ab4b81bc47ac29252ec762", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}] Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 3f2e1c5d022c4bde9e76b8a933739557 Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.823289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '9ad1d56f-357d-443c-a043-471ab99f59e6'} Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:55.824882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.828228 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.835555 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Returning 404 to user: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:55.836472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b283915b-4070-4ace-8817-ecfb07e9bc6f tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 404 len: 111 microversion: 2.1 time: 0.130539 Jun 06 14:29:55.839456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 468/969] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:55 2022] DELETE /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:55.852157 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:55.855352 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9ad1d56f-357d-443c-a043-471ab99f59e6] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:55.867530 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:55.869077 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:55.870487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:55.871555 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:55.903467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] HTTP exception thrown: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Request method failure captured: Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 HTTP/1.1 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2vH9sXMgnwFAp1rHjb6T0-nCT1PBhlYy8qEzbjDwWbkQM9paAf2dcPpQnNkUkVzSTYTStFu6UQk5ncxUoyIsUJxdD3XKBSRHuZfVf3PNtRsgxXphcQIUl7WQPZQbxUEAG7QU-UTyRG0RM7Ug_5F_mgBZmcMv8Ph3mfnWEW7zf7ah4 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:55.909988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c41996fbf4ab4b81bc47ac29252ec762", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}] Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 3f2e1c5d022c4bde9e76b8a933739557 Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.912883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '9ad1d56f-357d-443c-a043-471ab99f59e6'} Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:55.914471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. Jun 06 14:29:55.918802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:55.923551 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Returning 404 to user: Instance 9ad1d56f-357d-443c-a043-471ab99f59e6 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:55.936535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1398f02a-7a6c-4484-83ae-2c9d3e500595 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6" status: 404 len: 111 microversion: 2.1 time: 0.081639 Jun 06 14:29:55.938430 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 502/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:55 2022] GET /compute/v2.1/servers/9ad1d56f-357d-443c-a043-471ab99f59e6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:57.312907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:57.314300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:57.322466 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:57.323219 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:57.324457 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:57.325224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:57.360088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] HTTP exception thrown: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Request method failure captured: Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 HTTP/1.1 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2vH9sXMgnwFAp1rHjb6T0-nCT1PBhlYy8qEzbjDwWbkQM9paAf2dcPpQnNkUkVzSTYTStFu6UQk5ncxUoyIsUJxdD3XKBSRHuZfVf3PNtRsgxXphcQIUl7WQPZQbxUEAG7QU-UTyRG0RM7Ug_5F_mgBZmcMv8Ph3mfnWEW7zf7ah4 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:29:57.363637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c41996fbf4ab4b81bc47ac29252ec762", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}] Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 3f2e1c5d022c4bde9e76b8a933739557 Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.366566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '9070a8fe-f081-4116-9cf2-81094e156184'} Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:57.369050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.372498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.378001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Returning 404 to user: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:57.378001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-629695ce-8e11-41df-badd-65362abe30b5 tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 404 len: 111 microversion: 2.1 time: 0.059112 Jun 06 14:29:57.378001 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 469/971] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:29:57 2022] DELETE /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:29:57.384425 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:29:57.386657 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] [instance: 9070a8fe-f081-4116-9cf2-81094e156184] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:29:57.411535 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:57.412345 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:57.413880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:29:57.414671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:29:57.444590 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] HTTP exception thrown: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Request method failure captured: Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 HTTP/1.1 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2vH9sXMgnwFAp1rHjb6T0-nCT1PBhlYy8qEzbjDwWbkQM9paAf2dcPpQnNkUkVzSTYTStFu6UQk5ncxUoyIsUJxdD3XKBSRHuZfVf3PNtRsgxXphcQIUl7WQPZQbxUEAG7QU-UTyRG0RM7Ug_5F_mgBZmcMv8Ph3mfnWEW7zf7ah4 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:29:57.448820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c41996fbf4ab4b81bc47ac29252ec762"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c41996fbf4ab4b81bc47ac29252ec762", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c41996fbf4ab4b81bc47ac29252ec762"}]}] Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: c41996fbf4ab4b81bc47ac29252ec762 Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-866352707 Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 3f2e1c5d022c4bde9e76b8a933739557 Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeTestJSON-866352707-project Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.451722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '9070a8fe-f081-4116-9cf2-81094e156184'} Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:29:57.453309 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. Jun 06 14:29:57.455710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:29:57.459048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] Returning 404 to user: Instance 9070a8fe-f081-4116-9cf2-81094e156184 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:29:57.459048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-02d77ee2-1006-424a-8144-f46a7c51023c tempest-AttachVolumeTestJSON-866352707 tempest-AttachVolumeTestJSON-866352707-project] 10.222.0.13 "GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184" status: 404 len: 111 microversion: 2.1 time: 0.074653 Jun 06 14:29:57.459048 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 503/972] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:29:57 2022] GET /compute/v2.1/servers/9070a8fe-f081-4116-9cf2-81094e156184 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:30:04.076816 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4dfbe19-46dd-4d82-9583-1a83ffe923c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Action: 'create', calling method: .version_select at 0x7fae900b8430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1201179128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWKfKESqD4duQc26Xpe6RtdtnM1sGHaCoq/+h/Kl+wuafC0SK0X6Hf4oy7l+UNFtwl23MjquuyydtsVnar6WTyfnFGoeUuJXoiuIsAiF7B66r/m1+xsBNmQ6BQsCjcRuw=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:04.102526 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-e4dfbe19-46dd-4d82-9583-1a83ffe923c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Getting quotas for project add30fb78c80414599ebb8f57fb31389. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:30:04.108173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-e4dfbe19-46dd-4d82-9583-1a83ffe923c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Getting quotas for user 4e867646e7734a24a574fcbce0b17c8b and project add30fb78c80414599ebb8f57fb31389. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:30:04.142551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4dfbe19-46dd-4d82-9583-1a83ffe923c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.612430 Jun 06 14:30:04.143096 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 470/973] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:30:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:09.974860 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-704691580"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:09.975616 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:09.988918 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:09.990472 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=21 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:09.993891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:09.994495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:09.995588 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:09.996063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:10.234507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.network.security_group_api [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Removing security group 92dc4775-04be-49ea-8805-c8efd1c6d350 from port 02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e Jun 06 14:30:10.809089 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c3c2647a-0982-494c-b954-f28f738d76ab tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/action" status: 202 len: 0 microversion: 2.1 time: 0.841143 Jun 06 14:30:10.814110 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 504/974] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:30:09 2022] POST /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:30:10.832792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=60,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:10.839245 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-4922f1f1-0740-4e65-921c-aa413911f15c req-ce0ff855-0bc0-45d4-814e-79b2f61ccd8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:10.882661 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-4922f1f1-0740-4e65-921c-aa413911f15c req-ce0ff855-0bc0-45d4-814e-79b2f61ccd8f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:10.884563 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-4922f1f1-0740-4e65-921c-aa413911f15c req-ce0ff855-0bc0-45d4-814e-79b2f61ccd8f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:10.900798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-4922f1f1-0740-4e65-921c-aa413911f15c req-ce0ff855-0bc0-45d4-814e-79b2f61ccd8f service nova] Creating event network-changed:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:30:10.918129 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-4922f1f1-0740-4e65-921c-aa413911f15c req-ce0ff855-0bc0-45d4-814e-79b2f61ccd8f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088999 Jun 06 14:30:10.921290 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 471/975] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:12.983630 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:12.984703 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:13.003290 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:13.007079 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:13.021750 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ffb2b7a7-2a13-48cf-b0d6-2459637e286a req-64f95c11-0050-4806-a7ad-09bcbe8cdae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:13.028211 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:13.036550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:13.078481 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ffb2b7a7-2a13-48cf-b0d6-2459637e286a req-64f95c11-0050-4806-a7ad-09bcbe8cdae6 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:13.079300 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ffb2b7a7-2a13-48cf-b0d6-2459637e286a req-64f95c11-0050-4806-a7ad-09bcbe8cdae6 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:13.182487 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ffb2b7a7-2a13-48cf-b0d6-2459637e286a req-64f95c11-0050-4806-a7ad-09bcbe8cdae6 service nova] Creating event network-changed:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:30:13.203577 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-ffb2b7a7-2a13-48cf-b0d6-2459637e286a req-64f95c11-0050-4806-a7ad-09bcbe8cdae6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187285 Jun 06 14:30:13.207370 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 472/976] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:13.697561 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lazy-loading 'services' on Instance uuid 0295b34b-3e1d-4b32-9372-4296fda63d08 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:30:13.963136 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e9495c2b-16ef-4173-874a-0b1a6eaead44 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments/5c1376fd-2324-4dac-90d0-b7d8c80a8db5" status: 202 len: 0 microversion: 2.1 time: 0.981381 Jun 06 14:30:13.966789 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 505/977] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:30:12 2022] DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments/5c1376fd-2324-4dac-90d0-b7d8c80a8db5 => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:30:13.976386 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:13.978329 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:13.988670 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:13.989495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:13.990554 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:13.991220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:14.126256 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:14.160121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4030641-f7a1-4ece-80e8-702165196d5b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188084 Jun 06 14:30:14.168342 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 473/978] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:30:13 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:15.206813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:15.212481 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:15.221644 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:15.222500 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:15.224364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:15.225193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:15.262972 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b8b01897-2534-42cc-bf56-fdb67ccb9e9b tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090902 Jun 06 14:30:15.263883 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 506/979] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 14:30:15 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 14:30:15.275581 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:15.276337 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:15.283099 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:15.283538 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:15.284566 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:15.285233 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:15.414282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] HTTP exception thrown: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 is not attached to volume 5c1376fd-2324-4dac-90d0-b7d8c80a8db5 Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Request method failure captured: Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments/5c1376fd-2324-4dac-90d0-b7d8c80a8db5 HTTP/1.1 Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing7RGpCc3kuauz-SwqT0QPCWbhAlHxUxugMzApguQIrbZgzos1c4erxlZ5TsZWZmcpN6hIeFQ9lnu9DYSR-bEdvRlKjXojzbLwP-rVQgKEbU6If2-F2xLSzhtRiCpVRwphu1t2Ai1_S2_gTgjugXNCptArAJAAKXIZqW9hhE1XpNbIQ Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: d1af47083c644609a4a84b1273a4087f Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestMinimumBasicScenario-62961042 Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:30:15.429988 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1af47083c644609a4a84b1273a4087f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d1af47083c644609a4a84b1273a4087f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d1af47083c644609a4a84b1273a4087f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1af47083c644609a4a84b1273a4087f"}]}] Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestMinimumBasicScenario-62961042 Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: d1af47083c644609a4a84b1273a4087f Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-62961042 Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-TestMinimumBasicScenario-62961042-project Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 791369c0e2574cdf8047a5f178a3c6db Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestMinimumBasicScenario-62961042-project Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:30:15.433085 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 is not attached to volume 5c1376fd-2324-4dac-90d0-b7d8c80a8db5 Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'server_id': '0295b34b-3e1d-4b32-9372-4296fda63d08', 'id': '5c1376fd-2324-4dac-90d0-b7d8c80a8db5'} Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5c1376fd-2324-4dac-90d0-b7d8c80a8db5. Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:15.435311 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 is not attached to volume 5c1376fd-2324-4dac-90d0-b7d8c80a8db5 Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 is not attached to volume 5c1376fd-2324-4dac-90d0-b7d8c80a8db5 Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:15.438793 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Returning 404 to user: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 is not attached to volume 5c1376fd-2324-4dac-90d0-b7d8c80a8db5 {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:15.441854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ac7b26d8-77eb-4c51-a5a3-3ba2d4ae3f70 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments/5c1376fd-2324-4dac-90d0-b7d8c80a8db5" status: 404 len: 154 microversion: 2.1 time: 0.161154 Jun 06 14:30:15.441854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 474/980] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 14:30:15 2022] DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08/os-volume_attachments/5c1376fd-2324-4dac-90d0-b7d8c80a8db5 => generated 154 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:30:16.700601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:16.701576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:16.713948 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:16.714749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:16.716129 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:16.716895 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:16.748586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:30:16.864003 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7b631ab0-9f49-4774-86c5-29b5bf7c0495 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 204 len: 0 microversion: 2.1 time: 0.171257 Jun 06 14:30:16.865215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 507/981] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:30:16 2022] DELETE /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 14:30:16.875526 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:16.876379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:16.878664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:16.887050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:16.887851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:16.888784 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:16.889540 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:17.369531 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:17.379927 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cbb0603c-86e2-43a8-a03c-3a534ba40b0f tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1554 microversion: 2.1 time: 0.508381 Jun 06 14:30:17.381788 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 475/982] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:16 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1554 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:18.399931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:18.400823 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:18.407729 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:18.408188 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:18.408995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:18.409431 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:18.629132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:18.638786 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5fc1019e-bb59-4cfc-898d-7131cac2b922 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1554 microversion: 2.1 time: 0.245314 Jun 06 14:30:18.653750 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 508/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:18 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:19.357764 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:19.359310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:19.378481 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.379752 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.381718 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.382393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.428533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4bcfe84-135b-472d-9603-190d5f449411 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075094 Jun 06 14:30:19.435761 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 476/984] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 14:30:19 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:19.603838 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:19.604636 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:19.616825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.620406 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.621675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.622380 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.657394 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:30:19.679697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:19.680818 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:19.703896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.704345 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.705258 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.705776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.877907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:19.889698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-daaf6b01-5437-4687-a9e0-a16dbea9d931 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1512 microversion: 2.1 time: 0.213871 Jun 06 14:30:19.891293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 477/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:19 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:19.896268 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-0e912952-9e1f-41a9-9390-c730e2a6f91a req-065efaf9-76e0-4b49-97cd-cee1c6a28036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0295b34b-3e1d-4b32-9372-4296fda63d08", "name": "network-vif-deleted", "tag": "02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:19.906938 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-0e912952-9e1f-41a9-9390-c730e2a6f91a req-065efaf9-76e0-4b49-97cd-cee1c6a28036 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.907812 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-0e912952-9e1f-41a9-9390-c730e2a6f91a req-065efaf9-76e0-4b49-97cd-cee1c6a28036 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.944626 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-0e912952-9e1f-41a9-9390-c730e2a6f91a req-065efaf9-76e0-4b49-97cd-cee1c6a28036 service nova] Creating event network-vif-deleted:02e3f9a2-24eb-4ed2-b8c3-852b2dfd461e for instance 0295b34b-3e1d-4b32-9372-4296fda63d08 on hv-cinder-84414 Jun 06 14:30:19.948822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-57a9da32-5fef-435a-8757-e977c6a43c6a tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 204 len: 0 microversion: 2.20 time: 0.349261 Jun 06 14:30:19.949809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 509/986] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 14:30:19 2022] DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 06 14:30:19.959624 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-0e912952-9e1f-41a9-9390-c730e2a6f91a req-065efaf9-76e0-4b49-97cd-cee1c6a28036 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066815 Jun 06 14:30:19.962253 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 478/987] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:19.963218 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:19.965272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:19.973639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.974858 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:19.976780 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:19.978090 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:20.209099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:20.220299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:20.222282 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:20.223639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fd3e027d-6b87-478c-b6ae-87731f35624c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.269105 Jun 06 14:30:20.236333 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 510/988] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:19 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:30:20.924044 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:20.927462 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:20.942057 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:20.942501 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:20.943728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:20.944384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:20.987775 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:20.988572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:20.989080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lazy-loading 'fault' on Instance uuid 0295b34b-3e1d-4b32-9372-4296fda63d08 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:30:21.067175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791369c0e2574cdf8047a5f178a3c6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1af47083c644609a4a84b1273a4087f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:21.091499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-09a68d31-1ebd-4168-8b3a-66198c2e37d9 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 200 len: 1348 microversion: 2.1 time: 0.173975 Jun 06 14:30:21.093326 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 479/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:20 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 1348 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:30:21.251798 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:21.253932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:21.267412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:21.268335 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:21.269867 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:21.270991 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:21.490306 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:21.500734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:21.503206 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:21.504804 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fcd94d31-aeea-4a0f-a982-c796af0672ea tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.263881 Jun 06 14:30:21.505412 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 511/990] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:21 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:30:22.115861 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:22.118645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] [instance: 0295b34b-3e1d-4b32-9372-4296fda63d08] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:22.133200 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:22.134717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:22.136727 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:22.137642 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:22.166610 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] HTTP exception thrown: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 could not be found. Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Request method failure captured: Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 HTTP/1.1 Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing7RGpCc3kuauz-SwqT0QPCWbhAlHxUxugMzApguQIrbZgzos1c4erxlZ5TsZWZmcpN6hIeFQ9lnu9DYSR-bEdvRlKjXojzbLwP-rVQgKEbU6If2-F2xLSzhtRiCpVRwphu1t2Ai1_S2_gTgjugXNCptArAJAAKXIZqW9hhE1XpNbIQ Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: d1af47083c644609a4a84b1273a4087f Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestMinimumBasicScenario-62961042 Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:30:22.169936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1af47083c644609a4a84b1273a4087f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d1af47083c644609a4a84b1273a4087f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d1af47083c644609a4a84b1273a4087f", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d1af47083c644609a4a84b1273a4087f"}]}] Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestMinimumBasicScenario-62961042 Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: d1af47083c644609a4a84b1273a4087f Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-62961042 Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-TestMinimumBasicScenario-62961042-project Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 791369c0e2574cdf8047a5f178a3c6db Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestMinimumBasicScenario-62961042-project Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 could not be found. Jun 06 14:30:22.172934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '0295b34b-3e1d-4b32-9372-4296fda63d08'} Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 could not be found. Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:22.175024 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 could not be found. Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 could not be found. Jun 06 14:30:22.179207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:22.189018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Returning 404 to user: Instance 0295b34b-3e1d-4b32-9372-4296fda63d08 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:22.189018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9c5f77ff-1bf3-4bd8-b51e-53d5dbca53d3 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08" status: 404 len: 111 microversion: 2.1 time: 0.077167 Jun 06 14:30:22.190543 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 480/991] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:22 2022] GET /compute/v2.1/servers/0295b34b-3e1d-4b32-9372-4296fda63d08 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:30:22.203661 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bce81f25-a3e1-47df-9146-7b34c57cd524 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] Calling method '.version_select at 0x7fae8a7145e0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:22.240285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bce81f25-a3e1-47df-9146-7b34c57cd524 tempest-TestMinimumBasicScenario-62961042 tempest-TestMinimumBasicScenario-62961042-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1050461738" status: 202 len: 0 microversion: 2.1 time: 0.044203 Jun 06 14:30:22.242209 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 512/992] 10.222.0.13 () {58 vars in 1271 bytes} [Mon Jun 6 14:30:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1050461738 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:30:22.528180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:22.529992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:22.544373 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:22.554794 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:22.557180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:22.558549 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:22.814114 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:22.825977 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:22.828550 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:22.830431 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1ec70cc6-d3a0-4d8d-b64d-546f9173d4f9 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1723 microversion: 2.20 time: 0.309454 Jun 06 14:30:22.831422 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 481/993] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:22 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:30:23.663486 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-7b14cc8d-d1c5-4954-92f4-1cd03852dc5b req-07faab7b-426b-4b9b-aad6-0dfb71306f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a", "name": "network-vif-deleted", "tag": "00be5767-88c2-478d-a1ae-cc4eac3793c2"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:23.693254 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-7b14cc8d-d1c5-4954-92f4-1cd03852dc5b req-07faab7b-426b-4b9b-aad6-0dfb71306f5d service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:23.700136 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-7b14cc8d-d1c5-4954-92f4-1cd03852dc5b req-07faab7b-426b-4b9b-aad6-0dfb71306f5d service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:23.730358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-7b14cc8d-d1c5-4954-92f4-1cd03852dc5b req-07faab7b-426b-4b9b-aad6-0dfb71306f5d service nova] Creating event network-vif-deleted:00be5767-88c2-478d-a1ae-cc4eac3793c2 for instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a on hv-cinder-84414 Jun 06 14:30:23.746453 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-7b14cc8d-d1c5-4954-92f4-1cd03852dc5b req-07faab7b-426b-4b9b-aad6-0dfb71306f5d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090918 Jun 06 14:30:23.748679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 513/994] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:23.855869 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:23.861548 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:23.878033 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:23.878882 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:23.888802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:23.889518 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:23.965611 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:23.966153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:23.966613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lazy-loading 'fault' on Instance uuid 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:30:24.084336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:24.103502 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:24.108379 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '405ac2f6c07545efaa818e10fc788c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52da965db3654006abddd5b40b0905c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:24.109477 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6c680cdb-821e-4db3-be44-4b024eb84c6c tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 200 len: 1371 microversion: 2.20 time: 0.263637 Jun 06 14:30:24.110088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 482/995] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:23 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 14:30:24.251777 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-797807467", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1201179128", "security_groups": [{"name": "tempest-secgroup-smoke-1923056894"}], "networks": [{"uuid": "5aaebfbc-d478-477c-b5e8-32d8ff91fb13"}], "block_device_mapping_v2": [{"uuid": "7ac6855e-cd19-4721-a030-89fc746a8d7d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:24.645515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] validate_networks() for [('5aaebfbc-d478-477c-b5e8-32d8ff91fb13', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:30:25.138285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:25.139642 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:25.156301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:25.157169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:25.158689 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:25.159565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:25.189919 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] HTTP exception thrown: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Request method failure captured: Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a HTTP/1.1 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2uDqsI-I4RyEAvYwvjfPgG6pzD3e0ISHq4ZGFxorsLUJ3RJ4SslxOmYa79fAfQPqZUjW9aCp1pGco8nRl_PVusxrJ63yBBuVR_cvwzJ4Mv1GnCtU4a9Rq4cYCXcNHSPgr7HL8Z1yGt_0hhzTQcTpwIQHFsyfidP96kadowNT8I36U Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:30:25.193011 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52da965db3654006abddd5b40b0905c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52da965db3654006abddd5b40b0905c2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}] Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 405ac2f6c07545efaa818e10fc788c05 Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:25.196614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a'} Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:25.200339 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:25.204463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:25.208719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Returning 404 to user: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:25.208719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dbd7bb89-67de-4a85-ae67-0a35d73b8641 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 404 len: 111 microversion: 2.20 time: 0.069162 Jun 06 14:30:25.208719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 483/996] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:25 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:30:25.213992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6ba932e5-230d-4cda-ad64-4ce4f8765906 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '.version_select at 0x7fae90113940>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:25.254680 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6ba932e5-230d-4cda-ad64-4ce4f8765906 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-590478536" status: 204 len: 0 microversion: 2.20 time: 0.048747 Jun 06 14:30:25.255664 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 484/997] 10.222.0.13 () {60 vars in 1258 bytes} [Mon Jun 6 14:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-590478536 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 14:30:25.647010 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:30:25.647620 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:30:25.648045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:30:25.648537 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:30:25.649191 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:30:25.680838 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:25.682420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:25.683687 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:25.684341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:25.719017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Getting quotas for project add30fb78c80414599ebb8f57fb31389. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:30:25.725419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Getting quotas for user 4e867646e7734a24a574fcbce0b17c8b and project add30fb78c80414599ebb8f57fb31389. Resources: {'ram', 'instances', 'cores'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:30:25.871489 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:30:25.876597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ac6855e-cd19-4721-a030-89fc746a8d7d',volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:30:26.129073 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6377a9e1-3931-4392-a81c-1fad46ef9039 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.887402 Jun 06 14:30:26.141740 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 514/998] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:30:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:30:26.155250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-57a03915-6c10-4491-af2b-dcd5e1f4e6f3 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:26.156139 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-57a03915-6c10-4491-af2b-dcd5e1f4e6f3 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:26.316949 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-57a03915-6c10-4491-af2b-dcd5e1f4e6f3 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:26.361509 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-57a03915-6c10-4491-af2b-dcd5e1f4e6f3 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1088 microversion: 2.1 time: 0.209039 Jun 06 14:30:26.367990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 485/999] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:26 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1088 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:27.401311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:27.402825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:27.425901 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:27.427442 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:27.431540 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:27.432467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:27.550880 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:27.563181 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-74e41036-64bb-442a-9188-319a8efbe5af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1186 microversion: 2.1 time: 0.168926 Jun 06 14:30:27.563950 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 515/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:27 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1186 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:28.160082 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:28.161781 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:28.182079 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:28.184780 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:28.186744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:28.187447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:28.270738 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] HTTP exception thrown: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Request method failure captured: Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a HTTP/1.1 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2uDqsI-I4RyEAvYwvjfPgG6pzD3e0ISHq4ZGFxorsLUJ3RJ4SslxOmYa79fAfQPqZUjW9aCp1pGco8nRl_PVusxrJ63yBBuVR_cvwzJ4Mv1GnCtU4a9Rq4cYCXcNHSPgr7HL8Z1yGt_0hhzTQcTpwIQHFsyfidP96kadowNT8I36U Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:30:28.273260 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52da965db3654006abddd5b40b0905c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52da965db3654006abddd5b40b0905c2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}] Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 405ac2f6c07545efaa818e10fc788c05 Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.275212 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a'} Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:28.276192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.278499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.281184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Returning 404 to user: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:28.281184 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d2b11203-b64e-42fc-b9a1-57630e4eff35 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 404 len: 111 microversion: 2.20 time: 0.130226 Jun 06 14:30:28.282281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 486/1001] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 14:30:28 2022] DELETE /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:30:28.296981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:28.298016 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:28.311971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:28.314586 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:28.315843 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:28.318046 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:28.351296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] HTTP exception thrown: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Request method failure captured: Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a HTTP/1.1 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2uDqsI-I4RyEAvYwvjfPgG6pzD3e0ISHq4ZGFxorsLUJ3RJ4SslxOmYa79fAfQPqZUjW9aCp1pGco8nRl_PVusxrJ63yBBuVR_cvwzJ4Mv1GnCtU4a9Rq4cYCXcNHSPgr7HL8Z1yGt_0hhzTQcTpwIQHFsyfidP96kadowNT8I36U Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:30:28.356659 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52da965db3654006abddd5b40b0905c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52da965db3654006abddd5b40b0905c2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}] Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 405ac2f6c07545efaa818e10fc788c05 Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.359629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a'} Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:28.362013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. Jun 06 14:30:28.364985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:28.370276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Returning 404 to user: Instance 7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:28.373624 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dcf0e068-1c2c-448c-bb4a-3afd07c8f068 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a" status: 404 len: 111 microversion: 2.20 time: 0.087082 Jun 06 14:30:28.375588 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 516/1002] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:28 2022] GET /compute/v2.1/servers/7f5e0a9a-f60c-4b3f-b6ae-b2bbbcc46d2a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:30:28.592104 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:28.595702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:28.642617 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:28.646409 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:28.652968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:28.654158 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:28.999137 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:29.050015 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c96dc4f5-a887-4ba5-82bd-da49e1c8d005 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1204 microversion: 2.1 time: 0.466173 Jun 06 14:30:29.052190 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 487/1003] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:28 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1204 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:29.728639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:29.732107 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:29.760570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:29.764003 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:29.775732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:29.777360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:29.828380 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] HTTP exception thrown: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Request method failure captured: Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 HTTP/1.1 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing2uDqsI-I4RyEAvYwvjfPgG6pzD3e0ISHq4ZGFxorsLUJ3RJ4SslxOmYa79fAfQPqZUjW9aCp1pGco8nRl_PVusxrJ63yBBuVR_cvwzJ4Mv1GnCtU4a9Rq4cYCXcNHSPgr7HL8Z1yGt_0hhzTQcTpwIQHFsyfidP96kadowNT8I36U Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:30:29.839261 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52da965db3654006abddd5b40b0905c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52da965db3654006abddd5b40b0905c2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}] Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: 405ac2f6c07545efaa818e10fc788c05 Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:29.842293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'd12d1c93-4204-4b5b-ab25-22a197f92d27'} Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:29.843675 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:29.847135 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:30:29.854879 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Returning 404 to user: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:29.878550 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e9696063-d00a-41f9-82a9-ac2545b05ec6 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 404 len: 111 microversion: 2.20 time: 0.162899 Jun 06 14:30:29.887730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 517/1004] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 14:30:29 2022] DELETE /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:30:29.903760 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:29.907734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] [instance: d12d1c93-4204-4b5b-ab25-22a197f92d27] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:29.933484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:29.934786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:29.943077 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:29.943719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:30.015934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] HTTP exception thrown: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Request method failure captured: Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 HTTP/1.1 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing2uDqsI-I4RyEAvYwvjfPgG6pzD3e0ISHq4ZGFxorsLUJ3RJ4SslxOmYa79fAfQPqZUjW9aCp1pGco8nRl_PVusxrJ63yBBuVR_cvwzJ4Mv1GnCtU4a9Rq4cYCXcNHSPgr7HL8Z1yGt_0hhzTQcTpwIQHFsyfidP96kadowNT8I36U Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:30:30.018558 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/52da965db3654006abddd5b40b0905c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_52da965db3654006abddd5b40b0905c2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/52da965db3654006abddd5b40b0905c2"}]}] Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 52da965db3654006abddd5b40b0905c2 Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1468578328 Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 405ac2f6c07545efaa818e10fc788c05 Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1468578328-project Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:30.020112 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'd12d1c93-4204-4b5b-ab25-22a197f92d27'} Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:30:30.020947 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. Jun 06 14:30:30.022336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:30:30.026684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] Returning 404 to user: Instance d12d1c93-4204-4b5b-ab25-22a197f92d27 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:30:30.033798 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d15946bd-8849-4e1a-a1e3-20686dba5b56 tempest-AttachVolumeShelveTestJSON-1468578328 tempest-AttachVolumeShelveTestJSON-1468578328-project] 10.222.0.13 "GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27" status: 404 len: 111 microversion: 2.20 time: 0.146774 Jun 06 14:30:30.035400 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 488/1005] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 14:30:29 2022] GET /compute/v2.1/servers/d12d1c93-4204-4b5b-ab25-22a197f92d27 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 14:30:30.090568 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:30.092267 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:30.109215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:30.110845 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:30.112677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:30.116897 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:30.285435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:30.314730 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4aa9460f-0b90-4def-af11-a655239f42aa tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1192 microversion: 2.1 time: 0.235261 Jun 06 14:30:30.315801 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 518/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:30 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1192 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:31.342774 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:31.343636 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:31.373424 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:31.374317 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:31.376860 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:31.379404 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:31.946408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:31.970601 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-be5be1ed-3e1e-48b8-89cd-fa9962331e87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.634364 Jun 06 14:30:31.971471 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 489/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:31 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:32.996399 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:32.998722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:33.013507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:33.014847 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:33.016662 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:33.018121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:33.262698 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:33.271183 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d0b963d0-0ad4-43c1-9641-eb66695bf31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.285669 Jun 06 14:30:33.275610 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 519/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:32 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:34.292061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:34.293825 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:34.316029 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:34.316751 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:34.318080 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:34.329336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:34.588617 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-c12eb90a-9ab4-42c5-aed8-4b868a1d3203 req-d060e782-cf62-4d81-b25c-00731df38926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:34.614163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-c12eb90a-9ab4-42c5-aed8-4b868a1d3203 req-d060e782-cf62-4d81-b25c-00731df38926 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:34.615500 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-c12eb90a-9ab4-42c5-aed8-4b868a1d3203 req-d060e782-cf62-4d81-b25c-00731df38926 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:34.701006 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-c12eb90a-9ab4-42c5-aed8-4b868a1d3203 req-d060e782-cf62-4d81-b25c-00731df38926 service nova] Creating event network-changed:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:30:34.712486 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-c12eb90a-9ab4-42c5-aed8-4b868a1d3203 req-d060e782-cf62-4d81-b25c-00731df38926 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159957 Jun 06 14:30:34.718790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 520/1009] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:35.206004 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:35.251088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2f1e58ee-6ea6-4467-b474-81a6302b1431 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.961273 Jun 06 14:30:35.254986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 490/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:34 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:36.269403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:36.274696 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=6 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:36.282887 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:36.284115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:36.318176 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:36.318962 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:36.320632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:36.321163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:36.329070 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:36.730904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:36.741835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1983b23f-519e-4a04-afdd-9cf9c69a509e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.474928 Jun 06 14:30:36.743932 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 521/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:36 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:37.769203 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:37.779091 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:37.791762 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:37.827489 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:37.836871 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:37.838873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:37.841559 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:38.548855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:38.581851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3ad8b511-e988-4c3a-99c6-fe7ba5964c92 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.814942 Jun 06 14:30:38.590218 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 491/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:37 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:39.609233 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:39.610121 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:39.629319 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:39.629822 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:39.630646 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:39.631153 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:40.668967 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:30:40.669889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:30:40.853857 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:40.868900 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-536bfb20-5ad6-4d74-a8c3-44554f2147b0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 1.265324 Jun 06 14:30:40.880622 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 522/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:39 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:41.893389 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:41.906642 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:41.929288 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:41.929671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:41.934917 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:41.938716 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:41.942027 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=91 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:42.599123 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:42.613552 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5b107304-e9d1-4329-a357-ce5bc8c07d0f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.728661 Jun 06 14:30:42.630381 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 492/1014] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:41 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:43.644215 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:43.645482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:43.685642 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:43.698399 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:43.704087 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:43.713533 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:43.715629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:44.068409 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:44.079173 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f9b2125a-1b07-440e-852b-d9fb54767d3e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.438992 Jun 06 14:30:44.080640 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 523/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:43 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:45.100682 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:45.102705 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:45.115155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:45.116520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:45.119301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:45.120441 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:45.578914 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:45.588771 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-360abcfe-c29d-47a3-8045-fc620f2a0c5b tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.495104 Jun 06 14:30:45.594331 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 493/1016] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:45 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:46.615609 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:46.616922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:46.630063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:46.630063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:46.630063 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:46.630916 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:46.849817 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:46.865930 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-57397273-6588-428c-8e98-7dc626ab0d94 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.257539 Jun 06 14:30:46.878650 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 524/1017] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:46 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:30:47.892934 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:47.893561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:47.897371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:30:47.902776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:47.903498 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:47.904514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:47.905164 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:48.153647 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:48.172446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-30f9a8ef-c226-4a6a-a9e9-190938489020 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.283400 Jun 06 14:30:48.174764 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 494/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:47 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:49.191539 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:49.193016 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:49.202762 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:49.203385 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:49.204172 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:49.204851 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:49.534403 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:49.558397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bfaeaed9-1c52-4289-b0cf-d577362e7628 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.371410 Jun 06 14:30:49.559747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 525/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:49 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:50.577915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:50.578653 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:50.589396 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:50.590182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:50.591182 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:50.591790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:50.791360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-a1e4af62-ceac-453c-b4f0-e824797f7f4b req-b4c25fdb-10d2-48c8-bed4-d53fe9310852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "name": "network-vif-plugged", "status": "completed", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:50.806743 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a1e4af62-ceac-453c-b4f0-e824797f7f4b req-b4c25fdb-10d2-48c8-bed4-d53fe9310852 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:50.807437 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a1e4af62-ceac-453c-b4f0-e824797f7f4b req-b4c25fdb-10d2-48c8-bed4-d53fe9310852 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:50.825671 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-a1e4af62-ceac-453c-b4f0-e824797f7f4b req-b4c25fdb-10d2-48c8-bed4-d53fe9310852 service nova] Creating event network-vif-plugged:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:30:50.833144 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-a1e4af62-ceac-453c-b4f0-e824797f7f4b req-b4c25fdb-10d2-48c8-bed4-d53fe9310852 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046815 Jun 06 14:30:50.835080 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 526/1020] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:30:50.850166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:50.884903 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dfcf3183-81a1-4116-921f-185373de46d6 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.308508 Jun 06 14:30:50.887187 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 495/1021] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:50 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:51.906021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:51.908643 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:51.923573 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:51.924572 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:51.926315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:51.927656 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:52.160813 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:52.194075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9e10a468-2d9d-406e-9990-5fa7d085e2c2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1260 microversion: 2.1 time: 0.294959 Jun 06 14:30:52.210563 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 527/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:51 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1260 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:30:53.226322 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:53.227310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:53.235202 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:53.235632 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:53.236717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:53.237173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:53.446852 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:53.464306 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66b40fab-62bc-432b-8b50-68181d5fbc87 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1444 microversion: 2.1 time: 0.242642 Jun 06 14:30:53.465833 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 496/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:53 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1444 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:30:53.482457 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:30:53.483947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:30:53.491307 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:53.491989 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:53.492982 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:53.493503 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:53.762959 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:30:53.789392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7e7403ed-2727-4b31-b190-ff6f651a6297 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1444 microversion: 2.1 time: 0.310111 Jun 06 14:30:53.805792 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 528/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:30:53 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1444 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:30:56.331273 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-dcb10c7e-1956-4910-917c-d157b1d0e8c1 req-2123e725-df32-41a2-8485-c7b89955adb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:30:56.340396 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-dcb10c7e-1956-4910-917c-d157b1d0e8c1 req-2123e725-df32-41a2-8485-c7b89955adb7 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:30:56.340839 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-dcb10c7e-1956-4910-917c-d157b1d0e8c1 req-2123e725-df32-41a2-8485-c7b89955adb7 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:30:56.353086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-dcb10c7e-1956-4910-917c-d157b1d0e8c1 req-2123e725-df32-41a2-8485-c7b89955adb7 service nova] Creating event network-changed:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:30:56.358705 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-dcb10c7e-1956-4910-917c-d157b1d0e8c1 req-2123e725-df32-41a2-8485-c7b89955adb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031236 Jun 06 14:30:56.359323 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 497/1025] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:31:24.976571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=11 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:24.978206 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=42 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:25.187555 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ea799619-836f-4ec4-85dc-421b3ce76720 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Action: 'create', calling method: .version_select at 0x7fae8a596820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1448842862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6WJEJ/gjPDhc5U31Qky1LZApbOAvrjiXB8OjnzBrHcrPfdGagOVgyAoqjAaV7VXFHx2hgaalSe0ou9KViLktPf0bXc6hR7Ps+RbEp6JBOvHicdM9jGq9CKbFrpWn0llA=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:31:25.202774 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-ea799619-836f-4ec4-85dc-421b3ce76720 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for project 8963278084b2491799c6c5e403b5cfcc. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:31:25.207332 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-ea799619-836f-4ec4-85dc-421b3ce76720 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for user c795167b3e194db6925da938d9572912 and project 8963278084b2491799c6c5e403b5cfcc. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:31:25.240716 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ea799619-836f-4ec4-85dc-421b3ce76720 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.269613 Jun 06 14:31:25.242601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 529/1026] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 14:31:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:31:47.808556 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=7 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:47.809224 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=31 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:47.813359 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-624943000", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448842862", "security_groups": [{"name": "tempest-secgroup-smoke-127961813"}], "block_device_mapping_v2": [{"uuid": "b543f1fb-5dad-4138-bedc-c7189de4d93c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ffd02b94-0815-4079-ba8c-cfb2a272a2a8"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:31:47.936138 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] validate_networks() for [('ffd02b94-0815-4079-ba8c-cfb2a272a2a8', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:31:48.315442 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:31:48.315862 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:31:48.316361 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:31:48.316766 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:31:48.317169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:31:48.326901 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:48.327349 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:48.328151 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:48.328582 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:48.345699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for project 8963278084b2491799c6c5e403b5cfcc. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:31:48.350174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for user c795167b3e194db6925da938d9572912 and project 8963278084b2491799c6c5e403b5cfcc. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:31:48.412445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:31:48.414859 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b543f1fb-5dad-4138-bedc-c7189de4d93c',volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:31:48.554046 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0d995cbb-2198-4340-add1-081842b47c0e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747056 Jun 06 14:31:48.554853 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 498/1027] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:31:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:31:48.562483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=4 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:48.563850 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:48.567520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7b92adc2-12b3-4f3a-baba-39d290c7ddbb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:48.568127 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7b92adc2-12b3-4f3a-baba-39d290c7ddbb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:48.626487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7b92adc2-12b3-4f3a-baba-39d290c7ddbb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:48.639232 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7b92adc2-12b3-4f3a-baba-39d290c7ddbb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1094 microversion: 2.1 time: 0.075574 Jun 06 14:31:48.639816 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 530/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:48 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:49.657078 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:49.657810 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:49.665485 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:49.665960 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:49.666733 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:49.667167 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:49.730439 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:49.738231 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-211cfcdd-44e9-4e65-855a-9a8d2d9ab46b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1210 microversion: 2.1 time: 0.085554 Jun 06 14:31:49.738786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 499/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:49 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:50.755475 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:50.756145 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:50.764407 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:50.764736 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:50.765523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:50.766192 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:50.915918 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:50.930502 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-14e153ab-8097-4b5b-a9ca-a0184f694ae9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.178485 Jun 06 14:31:50.931855 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 531/1030] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:50 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:51.212499 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-21c617b1-e1ef-4296-802c-d864a864a1de req-cca75a68-9063-4ace-962b-d4bb2f4120c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6ecb4a-e284-46d6-8d23-fd547177301f", "tag": "3b029fb5-aac2-4d83-b640-1a712732b4af"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:31:51.249588 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-21c617b1-e1ef-4296-802c-d864a864a1de req-cca75a68-9063-4ace-962b-d4bb2f4120c6 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:51.250587 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-21c617b1-e1ef-4296-802c-d864a864a1de req-cca75a68-9063-4ace-962b-d4bb2f4120c6 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:51.265406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-21c617b1-e1ef-4296-802c-d864a864a1de req-cca75a68-9063-4ace-962b-d4bb2f4120c6 service nova] Creating event network-changed:3b029fb5-aac2-4d83-b640-1a712732b4af for instance ce6ecb4a-e284-46d6-8d23-fd547177301f on hv-cinder-84414 Jun 06 14:31:51.271047 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-21c617b1-e1ef-4296-802c-d864a864a1de req-cca75a68-9063-4ace-962b-d4bb2f4120c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072337 Jun 06 14:31:51.272557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 500/1031] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:31:51.948105 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:51.948794 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:51.955275 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:51.955670 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:51.956440 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:51.956877 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:52.102272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:52.110122 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9f28ec59-c22c-47d5-a31a-064fc3982e09 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.165857 Jun 06 14:31:52.110693 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 532/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:51 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:53.128174 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:53.128858 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:53.136360 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:53.136869 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:53.137850 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:53.138366 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:53.270813 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:53.278547 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b7e279af-2098-49fd-a203-86d091d6adab tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.155707 Jun 06 14:31:53.279110 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 501/1033] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:53 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:54.295407 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:54.296017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:54.302857 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:54.303311 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:54.304069 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:54.304504 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:54.439772 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:54.447817 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-54ccd04c-d455-4e39-a67f-28c53135413a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.156204 Jun 06 14:31:54.448384 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 533/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:54 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:55.465310 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:55.465960 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:55.472634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:55.473047 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:55.473826 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:55.474255 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:55.603900 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:55.611723 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5c81595e-4ea3-419d-87e4-d7ab7a0eec0b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.151041 Jun 06 14:31:55.612291 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 502/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:55 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:56.629014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:56.629552 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:56.636706 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:56.637149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:56.637939 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:56.638374 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:56.770499 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:56.781580 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7785c28a-8cf2-4376-a53d-09570508d155 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.156218 Jun 06 14:31:56.782368 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 534/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:56 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:57.803966 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:57.804573 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:57.811720 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:57.812169 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:57.813061 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:57.813504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:57.954188 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:57.963851 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8127699a-3ba0-44ba-848c-8fdd7e16edcf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.163342 Jun 06 14:31:57.964985 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 503/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:57 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:31:58.984305 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:31:58.985276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:31:58.987861 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:31:58.994285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:58.994738 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:58.995529 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:31:58.995974 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:31:59.152896 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:31:59.161629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-24cb664e-88e4-4f5f-a2e5-a7c376dbfdac tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.181432 Jun 06 14:31:59.162315 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 535/1038] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:31:58 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:00.178551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:00.179274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:00.182843 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:32:00.183520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:32:00.190141 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:00.190583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:00.191366 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:00.191795 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:00.325363 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:00.332980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d309c6ce-ab04-4f7c-8a80-32b6c1499ea9 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.158407 Jun 06 14:32:00.333408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 504/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:00 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:01.011844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-87056015-365a-485b-b52e-7c5b31e9e6ad req-ed743694-a2e0-4623-9642-f8cdf0da2e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6ecb4a-e284-46d6-8d23-fd547177301f", "name": "network-vif-plugged", "status": "completed", "tag": "3b029fb5-aac2-4d83-b640-1a712732b4af"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:32:01.020193 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-87056015-365a-485b-b52e-7c5b31e9e6ad req-ed743694-a2e0-4623-9642-f8cdf0da2e4a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:01.020639 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-87056015-365a-485b-b52e-7c5b31e9e6ad req-ed743694-a2e0-4623-9642-f8cdf0da2e4a service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:01.034625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-87056015-365a-485b-b52e-7c5b31e9e6ad req-ed743694-a2e0-4623-9642-f8cdf0da2e4a service nova] Creating event network-vif-plugged:3b029fb5-aac2-4d83-b640-1a712732b4af for instance ce6ecb4a-e284-46d6-8d23-fd547177301f on hv-cinder-84414 Jun 06 14:32:01.039621 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-87056015-365a-485b-b52e-7c5b31e9e6ad req-ed743694-a2e0-4623-9642-f8cdf0da2e4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 Jun 06 14:32:01.040207 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 536/1040] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:32:01.349464 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:01.350089 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:01.358165 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:01.358610 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:01.359357 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:01.359784 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:01.500332 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:01.507962 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-43c60d75-9d73-4fa2-a768-cfa88bf98e6b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1265 microversion: 2.1 time: 0.162197 Jun 06 14:32:01.508671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 505/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:01 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:02.526139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:02.526835 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:02.533574 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:02.534058 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:02.534831 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:02.535268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:02.673636 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:02.681885 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9450e3d0-6488-4d7e-b881-e3233dd12169 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1453 microversion: 2.1 time: 0.160485 Jun 06 14:32:02.682504 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 537/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:02 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:02.698432 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:02.699048 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:02.705805 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:02.706343 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:02.707199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:02.707710 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:02.865220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:02.873639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-983c777c-6a7c-4b0f-b98e-36be6c3d5530 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1453 microversion: 2.1 time: 0.179612 Jun 06 14:32:02.874247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 506/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:02 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:04.633876 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-3a24c889-85a8-4dcd-8734-8e2d865c2ca2 req-e1993eef-2b0f-4f67-bb4b-eabeb13fa1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce6ecb4a-e284-46d6-8d23-fd547177301f", "tag": "3b029fb5-aac2-4d83-b640-1a712732b4af"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:32:04.642745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-3a24c889-85a8-4dcd-8734-8e2d865c2ca2 req-e1993eef-2b0f-4f67-bb4b-eabeb13fa1d8 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:04.643196 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-3a24c889-85a8-4dcd-8734-8e2d865c2ca2 req-e1993eef-2b0f-4f67-bb4b-eabeb13fa1d8 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:04.655197 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-3a24c889-85a8-4dcd-8734-8e2d865c2ca2 req-e1993eef-2b0f-4f67-bb4b-eabeb13fa1d8 service nova] Creating event network-changed:3b029fb5-aac2-4d83-b640-1a712732b4af for instance ce6ecb4a-e284-46d6-8d23-fd547177301f on hv-cinder-84414 Jun 06 14:32:04.660571 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-3a24c889-85a8-4dcd-8734-8e2d865c2ca2 req-e1993eef-2b0f-4f67-bb4b-eabeb13fa1d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030614 Jun 06 14:32:04.661278 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 538/1044] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:32:29.221458 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:32:29.222086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:32:53.353695 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:32:53.354368 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:32:54.679107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:32:54.679715 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:54.682587 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:32:54.683560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=46 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:32:54.690704 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:54.691147 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:54.692031 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:54.692539 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:54.720390 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lazy-loading 'flavor' on Instance uuid 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 14:32:54.803640 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-121d207f-2e9b-4620-b612-5e3ff00a9fcf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "POST /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c/action" status: 202 len: 0 microversion: 2.1 time: 0.130610 Jun 06 14:32:54.804227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 507/1045] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:32:54 2022] POST /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:32:54.810858 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=20 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:32:54.811482 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=40 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:32:54.816156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:54.816876 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:54.825185 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:54.826047 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:54.826881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:54.826993 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:55.102241 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:55.111358 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-09064039-22a5-4cca-9126-966eeca9fc43 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.302325 Jun 06 14:32:55.111955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 539/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:54 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:56.129482 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:56.130210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:56.137116 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:56.137551 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:56.138365 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:56.138792 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:56.326938 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:56.334370 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0aa8dcaa-ca9c-4688-8901-24f0a377e882 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.209187 Jun 06 14:32:56.334924 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 508/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:56 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:57.351686 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:57.352294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:57.359875 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:57.360351 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:57.361115 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:57.361545 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:57.498279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:57.506111 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e2a06ca3-f68f-4a99-9647-a8ddfbe190e4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.158168 Jun 06 14:32:57.506684 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 540/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:57 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:58.523875 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:58.524472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:58.531835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:58.532279 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:58.533031 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:58.533458 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:58.668684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:58.676822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0d40678e-9362-4144-8879-cafffb475ec9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.156797 Jun 06 14:32:58.677388 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 509/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:58 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:32:59.698129 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:32:59.698793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:32:59.705874 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:59.706327 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:59.707098 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:32:59.707536 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:32:59.853665 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:32:59.862763 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-822176f2-a926-49d9-84bc-86352609f6b5 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.168273 Jun 06 14:32:59.863271 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 541/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:32:59 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:00.880247 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:00.881128 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:00.889964 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:00.890504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:00.891381 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:00.891815 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:01.042358 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:01.051802 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2c4bb182-52b4-428e-8e89-993b3c9dd660 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.175371 Jun 06 14:33:01.052373 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 510/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:00 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:33:02.069558 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:02.070177 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:02.076714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:02.077154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:02.077943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:02.078372 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:02.220418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:02.230359 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7cb341a6-d684-4c2c-92fb-d0f75284d8c8 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.164561 Jun 06 14:33:02.230939 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 542/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:02 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:03.250210 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:03.250873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:03.257307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:03.257846 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:03.258614 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:03.259067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:03.392209 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:03.399817 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-79bfee62-8f31-44ef-bbaa-831551c4d31a tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.155262 Jun 06 14:33:03.400388 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 511/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:03 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:04.417248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:04.417934 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:04.424557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:04.425008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:04.425808 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:04.426248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:04.563759 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:04.571248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2cfc4bc1-6321-4b93-9aa7-f0a78f0672e2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.157914 Jun 06 14:33:04.571803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 543/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:04 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:05.588258 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:05.588857 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:05.597066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:05.597521 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:05.598335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:05.598778 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:05.734718 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:05.742756 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2dfb9c42-f427-4370-97f2-b129f7bf4dc0 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.158238 Jun 06 14:33:05.743347 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 512/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:05 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:06.759760 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:06.760373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:06.768393 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:06.768935 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:06.769648 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:06.770104 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:06.910515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:06.918419 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-04688d76-148c-47b0-86f3-0123b4d1e3e1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.162355 Jun 06 14:33:06.919491 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 544/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:06 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:07.939694 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:07.940958 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:07.947612 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:07.948062 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:07.948832 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:07.949261 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:08.094486 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:08.102109 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3511e9b3-0b40-4821-a6f2-9c2ddbbc9b89 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.169642 Jun 06 14:33:08.102668 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 513/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:07 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:09.119496 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:09.120152 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:09.128108 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:09.128627 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:09.129433 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:09.129911 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:09.266499 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:09.273908 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8990a626-6f78-4078-8ae5-e62c5e0fc79e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1510 microversion: 2.1 time: 0.158289 Jun 06 14:33:09.274466 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 545/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:09 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:09.290226 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:33:09.290783 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:09.298012 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:09.298457 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:09.299206 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:09.299631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:09.389901 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b50949b7-bce5-4c9c-abfb-3aba4c6836de tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "POST /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c/action" status: 202 len: 0 microversion: 2.1 time: 0.103547 Jun 06 14:33:09.390835 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 514/1059] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 14:33:09 2022] POST /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:33:09.398842 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:09.399455 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:09.405802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:09.406259 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:09.407033 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:09.407706 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:09.556955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:09.564676 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-73d70e2b-54c4-4aab-a631-5322841e4ff4 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1518 microversion: 2.1 time: 0.169568 Jun 06 14:33:09.565243 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 546/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:09 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:10.582437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:10.583122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:10.589242 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:10.589754 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:10.590560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:10.591250 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:10.730088 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:10.738645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-62429a49-7638-48ce-9a99-2071160df6af tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1520 microversion: 2.1 time: 0.160659 Jun 06 14:33:10.739215 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 515/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:10 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:11.295939 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-e356bffd-df44-4626-a039-af99569b63ed req-3b87cf5f-08cc-48e3-a3b7-b0b00db70c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "name": "network-vif-unplugged", "status": "completed", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:33:11.306508 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e356bffd-df44-4626-a039-af99569b63ed req-3b87cf5f-08cc-48e3-a3b7-b0b00db70c4f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:11.307032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e356bffd-df44-4626-a039-af99569b63ed req-3b87cf5f-08cc-48e3-a3b7-b0b00db70c4f service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:11.321968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-e356bffd-df44-4626-a039-af99569b63ed req-3b87cf5f-08cc-48e3-a3b7-b0b00db70c4f service nova] Creating event network-vif-unplugged:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:33:11.328274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-e356bffd-df44-4626-a039-af99569b63ed req-3b87cf5f-08cc-48e3-a3b7-b0b00db70c4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036965 Jun 06 14:33:11.330051 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 547/1062] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:33:11.756384 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:11.757065 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:11.764663 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:11.765122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:11.765896 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:11.766383 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:11.918639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:11.926990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c60b583-bcfc-4fec-a462-194afce91154 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.174484 Jun 06 14:33:11.927734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 516/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:11 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:12.944947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:12.945664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:12.953722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:12.954189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:12.954951 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:12.955376 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:13.092547 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:13.100156 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-62e6d638-9c92-43ab-997c-11eb43f3abaf tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.159413 Jun 06 14:33:13.100734 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 548/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:12 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:14.117335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:14.118008 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:14.124513 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:14.124962 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:14.125769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:14.126207 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:14.257728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:14.266161 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0fefbeb8-6390-4390-9aff-faf8ba4c773f tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.152542 Jun 06 14:33:14.266739 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 517/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:14 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:15.283485 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:15.284088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:15.290626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:15.291078 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:15.291846 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:15.292279 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:15.428061 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:15.436373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a3637b13-8303-460d-8947-4188d514a861 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.156233 Jun 06 14:33:15.436931 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 549/1066] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:15 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:16.453658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:16.454281 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:16.460820 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:16.461253 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:16.462037 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:16.462463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:16.594719 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:16.602192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-badeadc0-b26b-45c8-8d42-b9134594aee7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.153336 Jun 06 14:33:16.602751 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 518/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:16 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:17.619818 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:17.620427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:17.627089 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:17.627536 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:17.628301 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:17.628737 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:17.761113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:17.770194 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4122357b-837c-48b3-a483-89ec59594326 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.154190 Jun 06 14:33:17.770765 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 550/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:17 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:18.788417 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:18.789092 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:18.795972 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:18.796411 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:18.797159 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:18.797583 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:18.928121 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:18.935709 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-39fdd4fa-839b-47e4-99ea-5a15a91382ce tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.151986 Jun 06 14:33:18.936278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 519/1069] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:18 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:19.952817 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:19.953447 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:19.959978 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:19.960428 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:19.961189 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:19.961622 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:20.093949 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:20.101459 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-124f7b66-b1cd-4e9b-b69d-468ccad781d1 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.152692 Jun 06 14:33:20.102068 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 551/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:19 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:21.119301 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:21.119841 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:21.126897 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:21.127349 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:21.128104 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:21.128534 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:21.148233 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:33:21.268523 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:21.276153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6ffe4d84-ab73-4e31-9679-dbcbd606713e tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.160746 Jun 06 14:33:21.276720 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 520/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:21 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:21.427002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-1283f6dc-5786-4178-8edd-0a8a937a8bd4 req-9efda941-8b20-4816-a11e-401e52d0be90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "name": "network-vif-plugged", "status": "completed", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:33:21.435881 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-1283f6dc-5786-4178-8edd-0a8a937a8bd4 req-9efda941-8b20-4816-a11e-401e52d0be90 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:21.436538 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-1283f6dc-5786-4178-8edd-0a8a937a8bd4 req-9efda941-8b20-4816-a11e-401e52d0be90 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:21.447800 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-1283f6dc-5786-4178-8edd-0a8a937a8bd4 req-9efda941-8b20-4816-a11e-401e52d0be90 service nova] Creating event network-vif-plugged:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:33:21.453171 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-1283f6dc-5786-4178-8edd-0a8a937a8bd4 req-9efda941-8b20-4816-a11e-401e52d0be90 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092497 Jun 06 14:33:21.453769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 552/1072] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:33:22.293199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:22.293845 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:22.301371 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:22.301854 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:22.302619 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:22.303049 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:22.431752 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:22.441807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ea978633-5485-4691-b017-c460aff19681 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1576 microversion: 2.1 time: 0.152194 Jun 06 14:33:22.442408 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 521/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:22 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:33:23.460747 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:33:23.461427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:33:23.468820 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:23.469272 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:23.470074 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:33:23.470509 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:33:23.870205 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:33:23.878943 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7d9e751d-7ceb-4b84-981d-405d20c8a8fe tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1563 microversion: 2.1 time: 0.422811 Jun 06 14:33:23.879511 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 553/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:33:23 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1563 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:02.537926 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:02.538545 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:02.540453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=32 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:02.541137 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=8 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:02.547697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:02.548145 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:02.548906 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:02.549337 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:02.575631 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:34:02.652380 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-68da7260-ec62-4738-aa5b-f1cfd4827de0 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 204 len: 0 microversion: 2.1 time: 0.118124 Jun 06 14:34:02.652880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 522/1075] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:34:02 2022] DELETE /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:34:02.662196 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:02.662891 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:02.665224 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=30 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:02.665987 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=82 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:02.672516 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:02.672967 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:02.673769 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:02.674210 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:02.813139 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:02.821847 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bc3673f7-6cf2-4e83-9a61-cfd0fc8517ca tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1577 microversion: 2.1 time: 0.163847 Jun 06 14:34:02.822435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 554/1076] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:02 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:34:03.840162 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:03.840767 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:03.847393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:03.847855 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:03.848593 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:03.849018 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:03.986617 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:03.994094 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-32605539-dc7c-4ef8-9f3e-f5b88d8eb553 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1577 microversion: 2.1 time: 0.158199 Jun 06 14:34:03.994652 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 523/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:03 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:05.011341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:05.011937 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:05.019276 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:05.019737 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:05.020487 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:05.020920 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:05.087884 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:05.095942 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-507dda05-354c-4387-87b7-6906e36c7424 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 200 len: 1510 microversion: 2.1 time: 0.088547 Jun 06 14:34:05.096521 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 555/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:05 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:05.351641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-c5a898be-78de-486d-b860-ce4dacaf6b5f req-49d91091-c6f8-469c-bb71-0399d6f7d0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce6ecb4a-e284-46d6-8d23-fd547177301f", "name": "network-vif-deleted", "tag": "3b029fb5-aac2-4d83-b640-1a712732b4af"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:05.362122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-c5a898be-78de-486d-b860-ce4dacaf6b5f req-49d91091-c6f8-469c-bb71-0399d6f7d0fe service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:05.362563 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-c5a898be-78de-486d-b860-ce4dacaf6b5f req-49d91091-c6f8-469c-bb71-0399d6f7d0fe service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:05.376951 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-c5a898be-78de-486d-b860-ce4dacaf6b5f req-49d91091-c6f8-469c-bb71-0399d6f7d0fe service nova] Creating event network-vif-deleted:3b029fb5-aac2-4d83-b640-1a712732b4af for instance ce6ecb4a-e284-46d6-8d23-fd547177301f on hv-cinder-84414 Jun 06 14:34:05.382814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-c5a898be-78de-486d-b860-ce4dacaf6b5f req-49d91091-c6f8-469c-bb71-0399d6f7d0fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108982 Jun 06 14:34:05.383923 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 524/1079] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:34:06.113313 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:06.113981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:06.120360 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:06.120802 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:06.121574 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:06.122033 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:06.136348 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] HTTP exception thrown: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Request method failure captured: Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f HTTP/1.1 Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing-1XJ4HkMR99qFeiVFjlV9dyr1VyIofrFfbp3fubr4s_0a3Px3z2jV1A7yh76Zr9CI8adHKf4dtR3xFwhkvz9BtamRkGmFc332Hbsy-BJRRdSi4ZhlqhPiKqPMbpniFGIxnRXE-VGjnTkL3V3tsZyYHUt7p6pRemB-WilDmvk0SLLI Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:34:06.138014 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8963278084b2491799c6c5e403b5cfcc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}] Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: c795167b3e194db6925da938d9572912 Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:34:06.140221 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'ce6ecb4a-e284-46d6-8d23-fd547177301f'} Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:34:06.141679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:34:06.143124 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:34:06.144386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Returning 404 to user: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:34:06.144386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ba18dbc0-5bc7-4f46-aa36-91d4b24fb0ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 404 len: 111 microversion: 2.1 time: 0.030100 Jun 06 14:34:06.144386 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 556/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:06 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:34:06.249152 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-400614094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448842862", "security_groups": [{"name": "tempest-secgroup-smoke-127961813"}], "block_device_mapping_v2": [{"uuid": "b543f1fb-5dad-4138-bedc-c7189de4d93c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ffd02b94-0815-4079-ba8c-cfb2a272a2a8"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:06.367683 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] validate_networks() for [('ffd02b94-0815-4079-ba8c-cfb2a272a2a8', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:34:06.795915 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:34:06.796342 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:34:06.796816 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:34:06.797231 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:34:06.797650 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:34:06.806973 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:06.807427 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:06.808227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:06.808662 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:06.826205 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for project 8963278084b2491799c6c5e403b5cfcc. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:34:06.830887 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for user c795167b3e194db6925da938d9572912 and project 8963278084b2491799c6c5e403b5cfcc. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:34:06.889762 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:34:06.892271 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b543f1fb-5dad-4138-bedc-c7189de4d93c',volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:34:07.022923 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9133fdee-9380-4e8b-8420-dcbd992a08e4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777832 Jun 06 14:34:07.023472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 525/1081] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:34:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:34:07.033657 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7c6a3969-dab5-47d3-b968-7aa88ef77004 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:07.034316 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7c6a3969-dab5-47d3-b968-7aa88ef77004 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:07.087106 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7c6a3969-dab5-47d3-b968-7aa88ef77004 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:07.093961 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7c6a3969-dab5-47d3-b968-7aa88ef77004 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1094 microversion: 2.1 time: 0.064309 Jun 06 14:34:07.094513 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 557/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:07 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:08.111713 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6d8d6b76-ca9e-4b85-ba7d-4f545996c3d6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:08.112463 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6d8d6b76-ca9e-4b85-ba7d-4f545996c3d6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:08.170166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6d8d6b76-ca9e-4b85-ba7d-4f545996c3d6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:08.177010 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6d8d6b76-ca9e-4b85-ba7d-4f545996c3d6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1094 microversion: 2.1 time: 0.070104 Jun 06 14:34:08.177570 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 526/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:08 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:09.193397 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-056a406c-ca17-496b-a578-44e0b7d45622 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:09.194251 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-056a406c-ca17-496b-a578-44e0b7d45622 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:09.251196 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-056a406c-ca17-496b-a578-44e0b7d45622 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:09.257981 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-056a406c-ca17-496b-a578-44e0b7d45622 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1094 microversion: 2.1 time: 0.068319 Jun 06 14:34:09.258532 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 558/1084] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:09 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:10.275175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-297ca8c5-031e-4f1c-9464-d42a0a618913 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:10.275786 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-297ca8c5-031e-4f1c-9464-d42a0a618913 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:10.330830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-297ca8c5-031e-4f1c-9464-d42a0a618913 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:10.337623 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-297ca8c5-031e-4f1c-9464-d42a0a618913 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1094 microversion: 2.1 time: 0.066273 Jun 06 14:34:10.338283 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 527/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:10 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:11.360249 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:11.360878 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:11.367938 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:11.368382 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:11.369149 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:11.369579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:11.434116 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:11.446008 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3c0392eb-531a-482b-8cd5-1f1b7024e6fb tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1144 microversion: 2.1 time: 0.094572 Jun 06 14:34:11.447629 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 559/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:11 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:34:12.463639 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:12.465103 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:12.472539 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:12.472991 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:12.473918 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:12.474533 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:12.555275 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:12.565986 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8d3ae0fe-2474-4de9-ae94-f0f7f6765dfa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1210 microversion: 2.1 time: 0.106384 Jun 06 14:34:12.566568 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 528/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:12 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:13.470569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-27154f57-2dfb-45f1-bfdf-f1773e0a21cd req-4b9ed9df-fd30-487f-a15d-30824aa18a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf47d4c9-ee16-4cde-87a9-8ebd288e8650", "tag": "5cc47b67-1879-4b8d-b3d5-5d6d2e039282"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:13.488996 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-27154f57-2dfb-45f1-bfdf-f1773e0a21cd req-4b9ed9df-fd30-487f-a15d-30824aa18a16 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:13.489392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-27154f57-2dfb-45f1-bfdf-f1773e0a21cd req-4b9ed9df-fd30-487f-a15d-30824aa18a16 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:13.505638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-27154f57-2dfb-45f1-bfdf-f1773e0a21cd req-4b9ed9df-fd30-487f-a15d-30824aa18a16 service nova] Creating event network-changed:5cc47b67-1879-4b8d-b3d5-5d6d2e039282 for instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 on hv-cinder-84414 Jun 06 14:34:13.511377 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-27154f57-2dfb-45f1-bfdf-f1773e0a21cd req-4b9ed9df-fd30-487f-a15d-30824aa18a16 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046867 Jun 06 14:34:13.512251 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 560/1088] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:34:13.582811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:13.583549 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:13.590519 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:13.591166 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:13.592005 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:13.592451 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:13.730139 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:13.738811 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4c3773c8-041b-4146-bb7f-5ee420a5db53 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.159837 Jun 06 14:34:13.739702 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 529/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:13 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:14.756832 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:14.757523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:14.764081 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:14.765138 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:14.765947 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:14.766379 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:14.911890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:14.919837 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ff23c455-a2d4-4473-bad9-262e7363e039 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.167606 Jun 06 14:34:14.920467 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 561/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:14 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:15.936828 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:15.937437 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:15.944211 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:15.944693 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:15.945465 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:15.945930 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:16.089484 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:16.097572 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d3f39782-41f9-4a5b-bbbd-1c3106373840 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.164888 Jun 06 14:34:16.098197 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 530/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:15 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:17.114672 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:17.115281 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:17.122632 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:17.123094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:17.123973 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:17.124367 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:17.259557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:17.267638 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cf962407-318a-453b-b2b7-4de4c99ad860 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.156842 Jun 06 14:34:17.268213 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 562/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:17 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:18.284591 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:18.285220 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:18.287405 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:18.292987 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:18.293436 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:18.294216 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:18.294642 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:18.429600 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:18.437837 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c1c20319-90a5-4903-afad-1342a0a783b1 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.157275 Jun 06 14:34:18.438390 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 531/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:18 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:19.454902 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:19.455456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:19.457825 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=4 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:19.463341 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:19.463791 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:19.464557 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:19.464995 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:19.597954 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:19.605364 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dc7e5f70-0c1d-4c5e-a859-e4cea9c5a385 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.155227 Jun 06 14:34:19.605940 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 563/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:19 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:20.623249 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:20.624394 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:20.626821 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=10 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:20.632236 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:20.632679 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:20.633453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:20.633907 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:20.769856 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:20.777722 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1fc25682-5be5-4361-8f04-414b5231b43c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.158357 Jun 06 14:34:20.778290 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 532/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:20 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:21.591732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:34:21.592343 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:34:21.793895 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:21.794507 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:21.801245 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:21.801617 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:21.802427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:21.802861 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:21.946220 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:21.954435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-41615409-4e2b-483e-8217-1401b82bc911 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.164405 Jun 06 14:34:21.954984 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 564/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:21 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:22.972407 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:22.973037 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:22.979645 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:22.980100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:22.980866 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:22.981307 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:23.114870 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:23.122396 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f70b2c04-48bb-48d9-8001-61c5e6ee9640 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.154733 Jun 06 14:34:23.122961 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 533/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:22 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:24.139284 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:24.139929 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:24.147299 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:24.147749 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:24.148560 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:24.149002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:24.292975 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:24.301451 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cf0db9c2-5680-487c-a521-d82a183666cc tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.166053 Jun 06 14:34:24.302044 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 565/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:24 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:25.319067 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:25.319701 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:25.326559 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:25.327000 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:25.327761 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:25.328807 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:25.462292 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:25.470698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4fc588d-8fb2-4267-bf88-1333f8d941fa tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.155489 Jun 06 14:34:25.471285 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 534/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:25 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:34:25.701483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-680838fb-f82f-4c64-85a8-d22809f7a9e0 req-e0ce63c7-0808-4c8c-8d4b-04142c78575b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf47d4c9-ee16-4cde-87a9-8ebd288e8650", "name": "network-vif-plugged", "status": "completed", "tag": "5cc47b67-1879-4b8d-b3d5-5d6d2e039282"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:25.711548 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-680838fb-f82f-4c64-85a8-d22809f7a9e0 req-e0ce63c7-0808-4c8c-8d4b-04142c78575b service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:25.712032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-680838fb-f82f-4c64-85a8-d22809f7a9e0 req-e0ce63c7-0808-4c8c-8d4b-04142c78575b service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:25.725694 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-680838fb-f82f-4c64-85a8-d22809f7a9e0 req-e0ce63c7-0808-4c8c-8d4b-04142c78575b service nova] Creating event network-vif-plugged:5cc47b67-1879-4b8d-b3d5-5d6d2e039282 for instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 on hv-cinder-84414 Jun 06 14:34:25.731887 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-680838fb-f82f-4c64-85a8-d22809f7a9e0 req-e0ce63c7-0808-4c8c-8d4b-04142c78575b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034033 Jun 06 14:34:25.732809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 566/1100] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:34:26.487996 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:26.488604 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:26.495449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:26.495890 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:26.496654 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:26.497081 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:26.660445 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:26.668406 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-40eed86c-ac95-4426-8f8a-343bd4cc8148 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1265 microversion: 2.1 time: 0.184431 Jun 06 14:34:26.668992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 535/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:26 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:27.686486 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:27.687204 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:27.694565 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:27.695021 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:27.695809 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:27.696248 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:27.842908 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:27.850761 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0963404c-e84c-48d9-95b0-36d8def2e28b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1452 microversion: 2.1 time: 0.169127 Jun 06 14:34:27.851340 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 567/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:27 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:27.868520 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:27.869135 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:27.877564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:27.878043 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:27.878822 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:27.879255 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:28.020013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:28.028068 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a89179e4-5853-40ae-bfed-e0f0e6a95da6 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1452 microversion: 2.1 time: 0.163372 Jun 06 14:34:28.028654 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 536/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:27 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:29.784013 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-0faaf378-920e-4287-9282-1a78d63a9b54 req-3969668f-ea2d-469d-a82d-30c60c17fbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf47d4c9-ee16-4cde-87a9-8ebd288e8650", "tag": "5cc47b67-1879-4b8d-b3d5-5d6d2e039282"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:29.793045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0faaf378-920e-4287-9282-1a78d63a9b54 req-3969668f-ea2d-469d-a82d-30c60c17fbcf service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:29.793493 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0faaf378-920e-4287-9282-1a78d63a9b54 req-3969668f-ea2d-469d-a82d-30c60c17fbcf service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:29.806203 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-0faaf378-920e-4287-9282-1a78d63a9b54 req-3969668f-ea2d-469d-a82d-30c60c17fbcf service nova] Creating event network-changed:5cc47b67-1879-4b8d-b3d5-5d6d2e039282 for instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 on hv-cinder-84414 Jun 06 14:34:29.811268 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-0faaf378-920e-4287-9282-1a78d63a9b54 req-3969668f-ea2d-469d-a82d-30c60c17fbcf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031758 Jun 06 14:34:29.812030 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 568/1104] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:34:40.671062 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=34 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:40.672581 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=62 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:40.674706 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:40.675605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:40.680227 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:40.684511 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:34:40.696980 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:40.697844 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:40.699267 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:40.700066 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:40.755179 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:34:40.856110 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-48b9f768-bfef-4f46-ad39-e72f5b2806ec tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "DELETE /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 204 len: 0 microversion: 2.1 time: 0.189224 Jun 06 14:34:40.857623 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 537/1105] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:34:40 2022] DELETE /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:34:40.862491 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-cdf8ec15-1508-4f21-805b-fbcc3044a431 req-0764471d-55c3-4882-809a-8287532526f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:40.867129 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:40.867832 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:40.874751 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:40.877013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:40.877013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:40.877013 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:40.880480 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-cdf8ec15-1508-4f21-805b-fbcc3044a431 req-0764471d-55c3-4882-809a-8287532526f9 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:40.881101 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-cdf8ec15-1508-4f21-805b-fbcc3044a431 req-0764471d-55c3-4882-809a-8287532526f9 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:40.899244 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-cdf8ec15-1508-4f21-805b-fbcc3044a431 req-0764471d-55c3-4882-809a-8287532526f9 service nova] Creating event network-changed:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:34:40.905281 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-cdf8ec15-1508-4f21-805b-fbcc3044a431 req-0764471d-55c3-4882-809a-8287532526f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236984 Jun 06 14:34:40.906626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 569/1106] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:34:41.048327 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:41.061040 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0df40f52-7081-4c8b-b05b-085ac30251f2 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.198200 Jun 06 14:34:41.063287 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 538/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:40 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 14:34:42.087890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:42.089169 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:42.102002 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:42.102826 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:42.104293 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:42.105137 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:42.301072 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:42.309494 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-00c50d20-c066-4428-a13d-c0bfcb6f09c7 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1569 microversion: 2.1 time: 0.231403 Jun 06 14:34:42.310102 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 570/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:42 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:43.327637 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:43.328887 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:43.336369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:43.336819 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:43.337615 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:43.338114 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:43.516734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e867646e7734a24a574fcbce0b17c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add30fb78c80414599ebb8f57fb31389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:34:43.525192 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2da9637c-00dd-481f-b24a-c73826dabd30 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 200 len: 1450 microversion: 2.1 time: 0.201309 Jun 06 14:34:43.525992 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 539/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:43 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:34:43.643234 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-d41fe449-bb73-4841-b738-199a0e55f457 req-8da25e49-7902-40ef-8b38-6e65f14b48e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cb5f8-c799-4e8e-bf26-2ca18f9ec78c", "name": "network-vif-deleted", "tag": "ec94f552-03df-49e5-bf66-261965d27d90"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:34:43.657887 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d41fe449-bb73-4841-b738-199a0e55f457 req-8da25e49-7902-40ef-8b38-6e65f14b48e4 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:43.658833 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d41fe449-bb73-4841-b738-199a0e55f457 req-8da25e49-7902-40ef-8b38-6e65f14b48e4 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:43.683328 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-d41fe449-bb73-4841-b738-199a0e55f457 req-8da25e49-7902-40ef-8b38-6e65f14b48e4 service nova] Creating event network-vif-deleted:ec94f552-03df-49e5-bf66-261965d27d90 for instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c on hv-cinder-84414 Jun 06 14:34:43.693099 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-d41fe449-bb73-4841-b738-199a0e55f457 req-8da25e49-7902-40ef-8b38-6e65f14b48e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052851 Jun 06 14:34:43.694427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 571/1110] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:34:44.553378 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:44.554495 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] [instance: 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:34:44.561916 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:44.563336 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:44.564129 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:34:44.564557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:34:44.582895 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] HTTP exception thrown: Instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c could not be found. Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Request method failure captured: Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c HTTP/1.1 Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing9hOj9G4j60o2fVK0u0xNihAb4r3loMe_hg9zHsCc7Pa6-8it_1ZyLG41TYHgmE2r-LmBYaFoHcJf0B9uRaR2F72fD2t0aEycs-RqsQ-xCQdHKoLUHm1cQ49ZSbYynfHo8d6dxlnLo7IuIiBwxmUz93sK3T0y9ihKEAtREK3foSyMQ Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: add30fb78c80414599ebb8f57fb31389 Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestShelveInstance-1201890591 Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:34:44.584599 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/add30fb78c80414599ebb8f57fb31389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/add30fb78c80414599ebb8f57fb31389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_add30fb78c80414599ebb8f57fb31389", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/add30fb78c80414599ebb8f57fb31389"}]}] Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestShelveInstance-1201890591 Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: add30fb78c80414599ebb8f57fb31389 Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestShelveInstance-1201890591 Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-TestShelveInstance-1201890591-project Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: 4e867646e7734a24a574fcbce0b17c8b Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestShelveInstance-1201890591-project Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c could not be found. Jun 06 14:34:44.586641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': '123cb5f8-c799-4e8e-bf26-2ca18f9ec78c'} Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c could not be found. Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:34:44.587695 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c could not be found. Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c could not be found. Jun 06 14:34:44.589504 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:34:44.591122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Returning 404 to user: Instance 123cb5f8-c799-4e8e-bf26-2ca18f9ec78c could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:34:44.591122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3f5413c8-949b-4b0f-8f9d-1f013b7df210 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c" status: 404 len: 111 microversion: 2.1 time: 0.041345 Jun 06 14:34:44.591122 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 540/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:34:44 2022] GET /compute/v2.1/servers/123cb5f8-c799-4e8e-bf26-2ca18f9ec78c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:34:44.789741 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ee96f26e-984b-45f3-bb17-4400912c58a9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] Calling method '.version_select at 0x7fae8a62be50>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:34:44.823677 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ee96f26e-984b-45f3-bb17-4400912c58a9 tempest-TestShelveInstance-1201890591 tempest-TestShelveInstance-1201890591-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1201179128" status: 202 len: 0 microversion: 2.1 time: 0.038986 Jun 06 14:34:44.824537 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 572/1112] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jun 6 14:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1201179128 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:35:49.232171 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:35:49.233028 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:35:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:36:13.364890 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:36:13.365392 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:36:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:36:14.589978 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:14.590734 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:14.595607 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1751020551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448842862", "security_groups": [{"name": "tempest-secgroup-smoke-127961813"}], "block_device_mapping_v2": [{"uuid": "4f4436cd-370f-4c8d-ac1d-76798beaebee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ffd02b94-0815-4079-ba8c-cfb2a272a2a8"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:36:14.714990 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] validate_networks() for [('ffd02b94-0815-4079-ba8c-cfb2a272a2a8', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 14:36:15.085765 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 14:36:15.086199 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 14:36:15.086671 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 14:36:15.087079 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 14:36:15.087487 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 14:36:15.097180 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:15.097620 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:15.098443 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:15.098879 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:15.116279 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for project 8963278084b2491799c6c5e403b5cfcc. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 14:36:15.120218 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Getting quotas for user c795167b3e194db6925da938d9572912 and project 8963278084b2491799c6c5e403b5cfcc. Resources: {'ram', 'instances', 'cores'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 14:36:15.176925 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 14:36:15.179050 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f4436cd-370f-4c8d-ac1d-76798beaebee',volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 14:36:15.328530 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d72fea0c-e53a-4e9a-874f-9554ed234121 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.740457 Jun 06 14:36:15.329172 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 541/1113] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 14:36:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 14:36:15.337579 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=10 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:15.338998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:15.343614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b2e76d21-849a-4a71-acf8-ffed8bc993da tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:15.344483 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b2e76d21-849a-4a71-acf8-ffed8bc993da tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:15.403294 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b2e76d21-849a-4a71-acf8-ffed8bc993da tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:15.410956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b2e76d21-849a-4a71-acf8-ffed8bc993da tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1095 microversion: 2.1 time: 0.075113 Jun 06 14:36:15.411514 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 573/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:15 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:16.427920 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:16.428470 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:16.436433 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:16.436880 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:16.437654 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:16.438117 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:16.500744 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:16.510261 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-618ec25a-f947-4b94-9479-d29f5c4cdc41 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1193 microversion: 2.1 time: 0.085807 Jun 06 14:36:16.511052 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 542/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:16 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:17.528285 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:17.528902 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:17.537042 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:17.537795 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:17.538988 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:17.539722 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:17.681350 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:17.689726 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-48dd5a87-a7e5-4f1a-b85c-c52e7d5297ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.165205 Jun 06 14:36:17.691075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 574/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:17 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:18.268596 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-fc9614a5-6a7e-4a47-9b96-90686505581b req-3e65f20c-4259-4dee-9272-244ee705ffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e325b6-a49e-43bf-b51a-945fafe7f36e", "tag": "35c43b09-21d6-48dd-83bb-2ea1471751cc"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:36:18.289522 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-fc9614a5-6a7e-4a47-9b96-90686505581b req-3e65f20c-4259-4dee-9272-244ee705ffb0 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:18.290150 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-fc9614a5-6a7e-4a47-9b96-90686505581b req-3e65f20c-4259-4dee-9272-244ee705ffb0 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:18.309233 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-fc9614a5-6a7e-4a47-9b96-90686505581b req-3e65f20c-4259-4dee-9272-244ee705ffb0 service nova] Creating event network-changed:35c43b09-21d6-48dd-83bb-2ea1471751cc for instance f3e325b6-a49e-43bf-b51a-945fafe7f36e on hv-cinder-84414 Jun 06 14:36:18.314677 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-fc9614a5-6a7e-4a47-9b96-90686505581b req-3e65f20c-4259-4dee-9272-244ee705ffb0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050284 Jun 06 14:36:18.315958 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 543/1117] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:36:18.707685 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:18.708323 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:18.714904 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:18.715351 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:18.716114 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:18.716543 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:18.865745 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:18.873980 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3e58029d-8ece-4d06-8903-7fb8693ccb21 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.170655 Jun 06 14:36:18.874562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 575/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:18 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:19.893399 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:19.894176 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:19.900589 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:19.900931 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:19.901697 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:19.902155 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:20.032398 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:20.040830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-155002bf-2720-419f-9cf4-da071ecc5451 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.152588 Jun 06 14:36:20.041404 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 544/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:19 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:21.058094 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:21.058714 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:21.065390 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:21.065976 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:21.066758 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:21.067197 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:21.202195 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:21.209956 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e246b4d2-a495-4521-865d-e664faf36570 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.156097 Jun 06 14:36:21.210521 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 576/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:21 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:22.227565 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:22.228172 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:22.234958 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:22.235400 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:22.236153 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:22.236613 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:22.371753 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:22.379454 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a128512f-9022-4c12-89ba-9551dbdb2150 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.155705 Jun 06 14:36:22.380007 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 545/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:22 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:23.396435 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:23.397049 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:23.403523 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:23.403971 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:23.404732 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:23.405576 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:23.541541 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:23.549252 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4ad50e79-eada-4fa7-b1df-e2939c2b3a46 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.156669 Jun 06 14:36:23.551451 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 577/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:23 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:24.566938 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:24.567651 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:24.574564 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:24.575373 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:24.575776 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:24.576209 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:24.715769 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:24.723461 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8b36fc7b-9096-484b-99a0-cbabc6d4c510 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.161030 Jun 06 14:36:24.723993 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 546/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:24 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:25.742635 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell0:SELECT=2 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:25.891536 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:25.892168 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:25.898274 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:25.898724 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:25.899488 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:25.899922 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:26.037270 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:26.044718 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6892f375-6113-4f79-8424-56793c3711c3 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.307983 Jun 06 14:36:26.045265 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 578/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:25 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:27.062129 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:27.062768 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:27.064773 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:27.066107 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:36:27.072289 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:27.072732 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:27.073493 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:27.073955 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:27.209993 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:27.217450 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8c7770a6-4dc2-424e-b431-6666bbaf8d91 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.159134 Jun 06 14:36:27.218252 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 547/1125] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:27 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:28.234562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:28.235179 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:28.241811 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:28.242266 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:28.243045 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:28.243485 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:28.380844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:28.388803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d862a86-bb0d-487b-9c81-e3a1360f41ee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.158502 Jun 06 14:36:28.389373 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 579/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:28 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:29.406149 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:29.406895 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:29.413848 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:29.414293 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:29.415045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:29.415476 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:29.551204 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:29.558830 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-df6ed7b4-aea1-43e7-a571-acb6ac823905 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.156523 Jun 06 14:36:29.559400 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 548/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:29 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:30.192581 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-08a06910-ffe0-4b47-938e-9cd0ea6180ff req-c138ef08-37b6-4c9e-8028-2ba4f79d0d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e325b6-a49e-43bf-b51a-945fafe7f36e", "name": "network-vif-plugged", "status": "completed", "tag": "35c43b09-21d6-48dd-83bb-2ea1471751cc"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:36:30.201383 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-08a06910-ffe0-4b47-938e-9cd0ea6180ff req-c138ef08-37b6-4c9e-8028-2ba4f79d0d28 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:30.201886 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-08a06910-ffe0-4b47-938e-9cd0ea6180ff req-c138ef08-37b6-4c9e-8028-2ba4f79d0d28 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:30.213146 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-08a06910-ffe0-4b47-938e-9cd0ea6180ff req-c138ef08-37b6-4c9e-8028-2ba4f79d0d28 service nova] Creating event network-vif-plugged:35c43b09-21d6-48dd-83bb-2ea1471751cc for instance f3e325b6-a49e-43bf-b51a-945fafe7f36e on hv-cinder-84414 Jun 06 14:36:30.218154 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-08a06910-ffe0-4b47-938e-9cd0ea6180ff req-c138ef08-37b6-4c9e-8028-2ba4f79d0d28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029915 Jun 06 14:36:30.218746 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 580/1128] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:36:30.576361 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:30.576965 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:30.583525 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:30.583968 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:30.584725 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:30.585149 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:30.738277 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:30.745900 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0f5cb101-86fd-4892-b49b-fcd378754819 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.173388 Jun 06 14:36:30.746453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 549/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:30 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:31.765418 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:31.766141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:31.772356 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:31.772803 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:31.773562 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:31.774028 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:31.907778 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:31.916456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b080f15d-f581-44c0-9851-6d945c82629e tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1266 microversion: 2.1 time: 0.155728 Jun 06 14:36:31.917017 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 581/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:31 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:32.933557 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:32.934173 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:32.941962 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:32.942412 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:32.943175 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:32.943603 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:33.090521 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:33.098178 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-db37e819-4d01-472b-b3c0-eae964c6716d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1453 microversion: 2.1 time: 0.168479 Jun 06 14:36:33.098745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 550/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:32 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:33.114814 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:36:33.115432 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:36:33.122039 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:33.122495 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:33.123264 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:33.123710 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:33.254110 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:36:33.261998 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a4e0b89a-578a-49e8-94be-3971ec990c5d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1453 microversion: 2.1 time: 0.151567 Jun 06 14:36:33.262569 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 582/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:36:33 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:36:35.208643 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-be0659c4-4968-400b-91b7-5a06b4cbc182 req-bc28f22a-f460-4dde-9ec5-02baf2186eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e325b6-a49e-43bf-b51a-945fafe7f36e", "tag": "35c43b09-21d6-48dd-83bb-2ea1471751cc"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:36:35.217512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-be0659c4-4968-400b-91b7-5a06b4cbc182 req-bc28f22a-f460-4dde-9ec5-02baf2186eb9 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:36:35.218605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-be0659c4-4968-400b-91b7-5a06b4cbc182 req-bc28f22a-f460-4dde-9ec5-02baf2186eb9 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:36:35.229641 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-be0659c4-4968-400b-91b7-5a06b4cbc182 req-bc28f22a-f460-4dde-9ec5-02baf2186eb9 service nova] Creating event network-changed:35c43b09-21d6-48dd-83bb-2ea1471751cc for instance f3e325b6-a49e-43bf-b51a-945fafe7f36e on hv-cinder-84414 Jun 06 14:36:35.235100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-be0659c4-4968-400b-91b7-5a06b4cbc182 req-bc28f22a-f460-4dde-9ec5-02baf2186eb9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030604 Jun 06 14:36:35.235698 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 551/1133] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:37:41.600626 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:37:41.601143 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:38:05.057354 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_api:SELECT=22 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:38:05.058141 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG dbcounter [-] [117603] Writing DB stats nova_cell1:SELECT=50 {{(pid=117603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:38:05.063020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:05.063520 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:05.065243 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-8ec5446d-6ea0-4afe-bb30-abf892fd4497 req-cc81ca3f-f2d4-43da-976a-4dcb199a3493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e325b6-a49e-43bf-b51a-945fafe7f36e", "tag": "35c43b09-21d6-48dd-83bb-2ea1471751cc"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:38:05.070514 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:38:05.071302 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=54 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 14:38:05.072615 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:05.073379 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:05.073985 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:05.074427 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:05.079936 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-8ec5446d-6ea0-4afe-bb30-abf892fd4497 req-cc81ca3f-f2d4-43da-976a-4dcb199a3493 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:05.080309 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-8ec5446d-6ea0-4afe-bb30-abf892fd4497 req-cc81ca3f-f2d4-43da-976a-4dcb199a3493 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:05.093728 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-8ec5446d-6ea0-4afe-bb30-abf892fd4497 req-cc81ca3f-f2d4-43da-976a-4dcb199a3493 service nova] Creating event network-changed:35c43b09-21d6-48dd-83bb-2ea1471751cc for instance f3e325b6-a49e-43bf-b51a-945fafe7f36e on hv-cinder-84414 Jun 06 14:38:05.099737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-8ec5446d-6ea0-4afe-bb30-abf892fd4497 req-cc81ca3f-f2d4-43da-976a-4dcb199a3493 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041719 Jun 06 14:38:05.100451 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 552/1134] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:38:05.105757 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:38:05.194559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d123bbf5-4185-47d0-8fb1-29b6889225cd tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 204 len: 0 microversion: 2.1 time: 0.137686 Jun 06 14:38:05.195449 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 583/1135] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:38:05 2022] DELETE /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:38:05.205743 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:05.206446 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:05.217033 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:05.217472 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:05.218282 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:05.218717 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:05.478045 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:38:05.485885 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-baae5556-8eec-4436-8215-646bef9d777d tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1578 microversion: 2.1 time: 0.285308 Jun 06 14:38:05.486456 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 553/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:05 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1578 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:38:06.504163 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:06.504866 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:06.512366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:06.512819 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:06.513614 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:06.514088 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:06.700707 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:38:06.708288 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b0235ee0-92d4-4717-97e3-4930739af229 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1578 microversion: 2.1 time: 0.208272 Jun 06 14:38:06.708844 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 584/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:06 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:38:07.588873 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-29e6ea7a-b7d8-47e2-a078-07878a5b99f1 req-aa9c184d-a31e-4c8a-b3d8-a2d882f129a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e325b6-a49e-43bf-b51a-945fafe7f36e", "name": "network-vif-deleted", "tag": "35c43b09-21d6-48dd-83bb-2ea1471751cc"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:38:07.597674 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-29e6ea7a-b7d8-47e2-a078-07878a5b99f1 req-aa9c184d-a31e-4c8a-b3d8-a2d882f129a9 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:07.598214 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-29e6ea7a-b7d8-47e2-a078-07878a5b99f1 req-aa9c184d-a31e-4c8a-b3d8-a2d882f129a9 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:07.613201 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-29e6ea7a-b7d8-47e2-a078-07878a5b99f1 req-aa9c184d-a31e-4c8a-b3d8-a2d882f129a9 service nova] Creating event network-vif-deleted:35c43b09-21d6-48dd-83bb-2ea1471751cc for instance f3e325b6-a49e-43bf-b51a-945fafe7f36e on hv-cinder-84414 Jun 06 14:38:07.619335 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-29e6ea7a-b7d8-47e2-a078-07878a5b99f1 req-aa9c184d-a31e-4c8a-b3d8-a2d882f129a9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Jun 06 14:38:07.619929 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 554/1138] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 14:38:07.726731 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:07.727366 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:07.734109 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:07.734559 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:07.735318 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:07.735751 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:07.796570 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:38:07.804113 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f3e5d9b3-73c8-4e8a-901a-a005ce6e4e4c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 200 len: 1226 microversion: 2.1 time: 0.081852 Jun 06 14:38:07.804664 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 585/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:07 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:38:08.823132 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:08.823737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: f3e325b6-a49e-43bf-b51a-945fafe7f36e] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:08.830102 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:08.830546 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:08.831306 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:08.831735 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:08.845086 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] HTTP exception thrown: Instance f3e325b6-a49e-43bf-b51a-945fafe7f36e could not be found. Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Request method failure captured: Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e HTTP/1.1 Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing-1XJ4HkMR99qFeiVFjlV9dyr1VyIofrFfbp3fubr4s_0a3Px3z2jV1A7yh76Zr9CI8adHKf4dtR3xFwhkvz9BtamRkGmFc332Hbsy-BJRRdSi4ZhlqhPiKqPMbpniFGIxnRXE-VGjnTkL3V3tsZyYHUt7p6pRemB-WilDmvk0SLLI Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:38:08.846731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8963278084b2491799c6c5e403b5cfcc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}] Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: c795167b3e194db6925da938d9572912 Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance f3e325b6-a49e-43bf-b51a-945fafe7f36e could not be found. Jun 06 14:38:08.848304 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'f3e325b6-a49e-43bf-b51a-945fafe7f36e'} Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e325b6-a49e-43bf-b51a-945fafe7f36e could not be found. Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:38:08.849239 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e325b6-a49e-43bf-b51a-945fafe7f36e could not be found. Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e325b6-a49e-43bf-b51a-945fafe7f36e could not be found. Jun 06 14:38:08.851561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:08.853274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Returning 404 to user: Instance f3e325b6-a49e-43bf-b51a-945fafe7f36e could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:38:08.853274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0ffa2e88-6a3a-4902-9baa-b556df1427e2 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e" status: 404 len: 111 microversion: 2.1 time: 0.030928 Jun 06 14:38:08.853274 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 555/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:08 2022] GET /compute/v2.1/servers/f3e325b6-a49e-43bf-b51a-945fafe7f36e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:38:11.919464 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:11.919968 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:11.921871 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-2d4e012f-a65b-40ba-8325-890a23a2619b req-78675ed7-8ebd-4aef-9375-d9dbccc10701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf47d4c9-ee16-4cde-87a9-8ebd288e8650", "tag": "5cc47b67-1879-4b8d-b3d5-5d6d2e039282"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:38:11.926893 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:11.927601 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:11.928456 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:11.928926 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:11.931560 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2d4e012f-a65b-40ba-8325-890a23a2619b req-78675ed7-8ebd-4aef-9375-d9dbccc10701 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:11.932222 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2d4e012f-a65b-40ba-8325-890a23a2619b req-78675ed7-8ebd-4aef-9375-d9dbccc10701 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:11.946295 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-2d4e012f-a65b-40ba-8325-890a23a2619b req-78675ed7-8ebd-4aef-9375-d9dbccc10701 service nova] Creating event network-changed:5cc47b67-1879-4b8d-b3d5-5d6d2e039282 for instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 on hv-cinder-84414 Jun 06 14:38:11.952711 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-2d4e012f-a65b-40ba-8325-890a23a2619b req-78675ed7-8ebd-4aef-9375-d9dbccc10701 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034180 Jun 06 14:38:11.953313 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 556/1141] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:38:11.958752 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 14:38:12.044797 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-65c65ec2-c84a-435a-b640-e887b7f35aee tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 204 len: 0 microversion: 2.1 time: 0.128954 Jun 06 14:38:12.045790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 586/1142] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:38:11 2022] DELETE /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 14:38:12.054982 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:12.055684 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:12.062447 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:12.063140 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:12.064286 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:12.065512 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:12.208393 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:38:12.217453 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d2f0d9bb-4748-4472-b432-217cd76a0b2c tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1577 microversion: 2.1 time: 0.167166 Jun 06 14:38:12.218501 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 557/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:12 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:38:13.236304 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:13.236915 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:13.243816 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:13.244269 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:13.245031 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:13.245471 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:13.381554 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:38:13.389796 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e00fdc9d-a3b1-439c-8f0c-0489b39a2fbf tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1577 microversion: 2.1 time: 0.158054 Jun 06 14:38:13.390368 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 587/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:13 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:38:14.300100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-47f29d8d-7f16-46bf-a201-23796a123ed6 req-dce8f013-3cfc-4aa6-97fc-f87d2f474500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf47d4c9-ee16-4cde-87a9-8ebd288e8650", "name": "network-vif-deleted", "tag": "5cc47b67-1879-4b8d-b3d5-5d6d2e039282"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 14:38:14.311910 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-47f29d8d-7f16-46bf-a201-23796a123ed6 req-dce8f013-3cfc-4aa6-97fc-f87d2f474500 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:14.312354 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-47f29d8d-7f16-46bf-a201-23796a123ed6 req-dce8f013-3cfc-4aa6-97fc-f87d2f474500 service nova] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:14.325338 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-47f29d8d-7f16-46bf-a201-23796a123ed6 req-dce8f013-3cfc-4aa6-97fc-f87d2f474500 service nova] Creating event network-vif-deleted:5cc47b67-1879-4b8d-b3d5-5d6d2e039282 for instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 on hv-cinder-84414 Jun 06 14:38:14.331618 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-47f29d8d-7f16-46bf-a201-23796a123ed6 req-dce8f013-3cfc-4aa6-97fc-f87d2f474500 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035092 Jun 06 14:38:14.332215 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 558/1145] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 14:38:14.407320 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:14.407925 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:14.415056 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:14.415515 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:14.416287 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:14.416725 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:14.481075 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c795167b3e194db6925da938d9572912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8963278084b2491799c6c5e403b5cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 14:38:14.488955 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fb31a36c-c910-4da9-bdb6-2833ceb45d3a tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 200 len: 1225 microversion: 2.1 time: 0.085527 Jun 06 14:38:14.489518 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 588/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:14 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 14:38:15.506449 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:15.507144 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: cf47d4c9-ee16-4cde-87a9-8ebd288e8650] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:15.514116 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:15.514561 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:15.515324 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:15.515758 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:15.529012 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] HTTP exception thrown: Instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 could not be found. Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Request method failure captured: Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 HTTP/1.1 Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing-1XJ4HkMR99qFeiVFjlV9dyr1VyIofrFfbp3fubr4s_0a3Px3z2jV1A7yh76Zr9CI8adHKf4dtR3xFwhkvz9BtamRkGmFc332Hbsy-BJRRdSi4ZhlqhPiKqPMbpniFGIxnRXE-VGjnTkL3V3tsZyYHUt7p6pRemB-WilDmvk0SLLI Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:38:15.530665 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8963278084b2491799c6c5e403b5cfcc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}] Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: c795167b3e194db6925da938d9572912 Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 could not be found. Jun 06 14:38:15.532634 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'cf47d4c9-ee16-4cde-87a9-8ebd288e8650'} Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 could not be found. Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:38:15.533605 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 could not be found. Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 could not be found. Jun 06 14:38:15.535278 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:15.536737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Returning 404 to user: Instance cf47d4c9-ee16-4cde-87a9-8ebd288e8650 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:38:15.536737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-efa7b4fd-e5f5-4d66-83de-5ee4e2f8b65b tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650" status: 404 len: 111 microversion: 2.1 time: 0.029821 Jun 06 14:38:15.536737 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 559/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:15 2022] GET /compute/v2.1/servers/cf47d4c9-ee16-4cde-87a9-8ebd288e8650 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:38:15.973420 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:15.974020 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:15.981679 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:15.982159 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:15.982979 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:15.983461 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:15.997317 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] HTTP exception thrown: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Request method failure captured: Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f HTTP/1.1 Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept: application/json Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Connection: close Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.13 Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABing-1XJ4HkMR99qFeiVFjlV9dyr1VyIofrFfbp3fubr4s_0a3Px3z2jV1A7yh76Zr9CI8adHKf4dtR3xFwhkvz9BtamRkGmFc332Hbsy-BJRRdSi4ZhlqhPiKqPMbpniFGIxnRXE-VGjnTkL3V3tsZyYHUt7p6pRemB-WilDmvk0SLLI Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member Jun 06 14:38:15.999065 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8963278084b2491799c6c5e403b5cfcc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}] Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Id: c795167b3e194db6925da938d9572912 Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: method: > Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: exception: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.000790 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'ce6ecb4a-e284-46d6-8d23-fd547177301f'} Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:38:16.001793 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.003253 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.005597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Returning 404 to user: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:38:16.005597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d3c087a0-ade6-4634-8e3f-c2a11b69f3ef tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 404 len: 111 microversion: 2.1 time: 0.036996 Jun 06 14:38:16.005597 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 589/1148] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 14:38:15 2022] DELETE /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:38:16.009658 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:16.010298 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] [instance: ce6ecb4a-e284-46d6-8d23-fd547177301f] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 14:38:16.016491 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:16.016939 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:16.017847 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 14:38:16.018276 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Lock "26f43c31-b475-46bf-a782-cf1fcb4532b4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 14:38:16.032997 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] HTTP exception thrown: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Request method failure captured: Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f HTTP/1.1 Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept: application/json Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Connection: close Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Length: 0 Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Content-Type: application/json Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Host: 10.222.0.13 Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABing-1XJ4HkMR99qFeiVFjlV9dyr1VyIofrFfbp3fubr4s_0a3Px3z2jV1A7yh76Zr9CI8adHKf4dtR3xFwhkvz9BtamRkGmFc332Hbsy-BJRRdSi4ZhlqhPiKqPMbpniFGIxnRXE-VGjnTkL3V3tsZyYHUt7p6pRemB-WilDmvk0SLLI Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Id: None Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Domain-Name: None Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Role: reader,member Jun 06 14:38:16.034544 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Roles: reader,member Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8963278084b2491799c6c5e403b5cfcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8963278084b2491799c6c5e403b5cfcc", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8963278084b2491799c6c5e403b5cfcc"}]}] Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 8963278084b2491799c6c5e403b5cfcc Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1680329229 Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Id: c795167b3e194db6925da938d9572912 Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1680329229-project Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: method: > Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: exception: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.036369 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: action_args: {'id': 'ce6ecb4a-e284-46d6-8d23-fd547177301f'} Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 14:38:16.041136 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. Jun 06 14:38:16.042790 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Jun 06 14:38:16.044746 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Returning 404 to user: Instance ce6ecb4a-e284-46d6-8d23-fd547177301f could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 14:38:16.044746 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1109851a-4c05-4b36-9dc0-70244ee997d4 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f" status: 404 len: 111 microversion: 2.1 time: 0.030472 Jun 06 14:38:16.044746 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 560/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 14:38:16 2022] GET /compute/v2.1/servers/ce6ecb4a-e284-46d6-8d23-fd547177301f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 14:38:17.329132 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4e08e321-f63e-4ff0-9640-85f0c67cc188 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] Calling method '.version_select at 0x7fae8a64ddc0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 14:38:17.360503 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4e08e321-f63e-4ff0-9640-85f0c67cc188 tempest-TestVolumeBootPattern-1680329229 tempest-TestVolumeBootPattern-1680329229-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1448842862" status: 202 len: 0 microversion: 2.1 time: 0.034853 Jun 06 14:38:17.361023 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 590/1150] 10.222.0.13 () {58 vars in 1262 bytes} [Mon Jun 6 14:38:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1448842862 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 14:39:00.688114 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:39:00.688699 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:39:09.242745 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:39:09.243596 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:39:33.374032 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:39:33.374692 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:39:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:41:01.609325 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:41:01.610625 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:41:04.614085 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:41:04.615296 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:41:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:41:30.508889 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:41:30.509527 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:41:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:42:20.696100 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:42:20.696731 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:42:29.251991 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:42:29.252814 dv-cinder-844140-2-iscsi devstack@n-api.service[117604]: Mon Jun 6 14:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 14:42:53.382537 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 14:42:53.383159 dv-cinder-844140-2-iscsi devstack@n-api.service[117603]: Mon Jun 6 14:42:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!